The ~"™ 


EIGHTH EDUCATIONAL CONFERENCE 
NEW YORK CITY 
October 26 and 27, 1939 
Under the auspices of 
The Educational Records Bureau 
The Cooperative Test Service 


The Committee on Measurement and Guidance 
of the American Council on Education 


The Commission on the Relation of School and College 
of the Progressive Education Association 


SUPPLEMENT NUMBER 13 
JANUARY 1940 


THE AMERICAN COUNCIL ON EDUCATION 











The 
EDUCATIONAL RECORD 


VOLUME XXI SUPPLEMENT NO. 13 


JANUARY 
1940 


COPYRIGHT, 1940, THE AMERICAN COUNCIL ON EDUCATION 





AMERICAN COUNCIL ON EDUCATION 
1939-40 


ADMINISTRATION 
OFFICERS 


CHAIRMAN: Mark A. May, director of the Institute of Human Relations, Yale 
University, representing Yale University 
First Vice CHAIRMAN: Walter C. Weidler, dean of the School of Commerce and 


Administration, Ohio State University, representing the American 
Association of Collegiate Schools of Business 


SEconD Vice CHAIRMAN: Edward B. Rooney, S.J., educational director of the 
Jesuit Schools in the United States, representing the American Jesuit 
Educational Association 


SECRETARY: Ernest O. Melby, dean of the School of Education, Northwestern 
University, representing Northwestern University 


TREASURER: Corcoran Thom, president of the American Security and Trust 


Company, Washington, D. C. 


EXECUTIVE COMMITTEE 
The Chairman and the Secretary of the American Council on Education 
Until May 1942: Herman L. Donovan, president of Eastern Kentucky State 
Teachers College, Richmond, Kentucky, representing the Southern Association 


of Colleges and Secondary Schools; Herbert E. Hawkes, dean of Columbia 
College, Columbia University, representing Columbia University 


Until May 1941: David E. Weglein, superintendent of schools, Baltimore, 
Maryland, representing the American Association of School Administrators; 
Laura Zirbes, professor of education, Ohio State University, representing the 
Progressive Education Association 


Until May 1940: Samuel P. Capen, chancellor of the University of Buffalo, 
representing the Association of American Colleges; Raymond A. Kent, presi- 
dent of the University of Louisville, representing the University of Louisville 


Ex officio: John W. Studebaker, United States Commissioner of Education 


EXECUTIVE OFFICERS 
GeorGE F. Zook, President 
C. R. Mann, President Emeritus 
C. S. Marsn, Vice President 
Ear J. McGrath, Specialist in Higher Education 
J. Harotp GoLprHorpe, Research Associate 
DONALD J. SHANK, Assistant to the President 
Grace R. OntricH, Chief Accountant 


Published Quarterly by 
THE AMERICAN COUNCIL ON EDUCATION 
744 Jackson Place, Washington, D. C. 
50 CENTS A COPY $2.00 A YEAR 


Entered as second-class matter June 8, 1932, at the Post Office at 
Washington, D. C., under the Act of August 24, 1912 












The Educational Record 


January 1940 
CLARENCE STEPHEN Marsu, Editor 


FOSS ESSE SSE SESS EEE eY 


CONTENTS 


ConTRIBUTORS TO THIS ISSUE 
























THE 1939 EDUCATIONAL CONFERENCE: A REVIEW 
Arthur E. Traxler 5 
MopeERNIZING REcorps FOR GUIDANCE AND TRANSFER 
Eugene R. Smith 17 
THE CurRRENT CoLLece ApMISSIONS SITUATION 
W. H. Cowley 34 
SoME VALUES OF PROGRESSIVE EDUCATION FOR WoMEN 
Marion E. Park 47 
Major Prosp_reMs IN OccupATIONAL ADJUSTMENT 
Edwin A. Lee 57 


Tue TEsTING OF COMPREHENSION Louis C. Zahner 71 
PERSPECTIVE UPON EDUCATION Henry M. Wriston 90 


J 


RECENT TRENDS IN THE COMPREHENSIVE EXAMINATION IN 


ENGLISH Edward §. Noyes 107 
Can We INFLUENCE MENTAL GrowTH: A CRITIQUE OF 

ReEcENT EXPERIMENTS Florence L. Goodenough 120 
THE SELECTION OF TEACHERS FROM THE NATIONAL 

VIEWPOINT A.J. Stoddard 144 


EDUCATION AND THE FUTURE OF THE PUBLIC SERVICE 
Luther H. Gulick 152 


Tue Present STATUS OF PERSONALITY TRAIT TESTS 
Robert G. Bernreuter 160 


PARENTS AND CUMULATIVE RECORDS Robert N. Hilkert 172 
Tue State TesTinc Leavers MeeT AGAIN Donald J.Shank 184 


NintH ANNUAL MEETING OF INSTITUTIONAL MEMBERS 
OF THE EDUCATIONAL Recorps BuREAU: COMMITTEE 
REPORTS 





190 


SO SS SESS SSS S SETS ETT TEE VTE S TY 





Contributors 


Robert G. BERNREUTER is associate 
professor and director of the Psycho- 
Educational Clinic of Pennsylvania 
State College. He has done much re- 
search in personality measurement and 
is a recognized authority in that field. 


W. H. Cow ey is president of Ham- 
ilton College. Before going to Hamil- 
ton in 1938, he was research associate 
in the Bureau of Educational Research 
and professor of psychology at Ohio 
State University. 


FLorENCE L. GoopENOUGH is profes- 
sor, Institute of Child Welfare, Uni- 
versity of Minnesota. She is well 
known for her research and writing 
in the fields of psychology and mental 
measurement. 


LuTHER H. Gutick is Eaton profes- 
sor of municipal science and admin- 
istration at Columbia University. He 
directed the New York State Regents’ 
Inquiry and is an outstanding author- 
ity on public administration. 


RoperT N. HiLkKertT is director of the 
Department of Personnel Study at the 
Hill School, Pottstown, Pennsylvania. 
His other educational activities have 
included the chairmanship of the Inde- 
pendent Schools Advisory Committee 


of the Educational Records Bureau 
and the presidency of the Science 
Teachers Association of the Middle 


Atlantic States. 


Epwin A. Lee is professor of educa- 
tion at Teachers College, Columbia 
University, and director of the Na- 
tional Occupational Conference. He 
has been superintendent of the San 
Francisco Public Schools and was for 
many years a member of the faculty 
of the Department of Education of the 
University of California. 


Epwarp S. Noyes is chairman of the 
Board of Admissions of Yale Univer- 
sity, where he is also associate profes- 
sor of English and fellow of Trumbull 
College. For many years he has been 
a reader of the Comprehensive English 


to This Issue 


Examination of the College Entrance 
Examination Board. 


Marion E. Park has been president 
of Bryn Mawr College since 1922. Dur- 
ing her career as the head of that in- 
stitution she has been a _ consistent 
leader in the work of liberalizing the 
curriculum for women. She is chair- 
man of the College Entrance Examina- 
tion Board. 


DonaLp J. SHANK is assistant to the 
President of the American Council on 
Education and secretary of the Coun- 
cil’s Committee on Measurement and 
Guidance and Committee on Student 
Personnel. 


EuGENE R. SMITH is headmaster of 
the Beaver Country Day School, 
Chestnut Hill, Massachusetts. He is 


chairman of the Committee on School 
and College Relations of the Educa- 
tional Records Bureau and chairman 
of the Reports and Records Committee 
of the Progressive Education Associa- 
tion. 


A. J. STopDARD is superintendent of 
the Philadelphia Public Schools. He 
has been superintendent of the public 
schools of Denver and Providence. He 
is chairman of the Educational Policies 
Commission of the National Education 
Association and chairman of the Na- 
tional Committee on Teacher Examina- 
tions of the American Council on Edu- 
cation. 


ARTHUR E. TRAXLER is assistant di- 
rector of the Educational Records 
Bureau. He was formerly psychologist 
at the University of Chicago High 
School. 


Henry M. Wriston is president of 
Brown University. He was formerly 
president of Lawrence College and for 
many years was professor of history 
at Wesleyan University. 


Louis C. ZAHNER is head of the Eng- 
lish Department, Groton School, Gro- 
ton, Massachusetts, and lecturer in the 
teaching of English, Graduate School 
of Education, Harvard University. 








The Educational Record 





1939 Educational Conference: 
A Review 


By ARTHUR E. TRAXLER 


MONG the many educational meetings that take place 
annually in America, a series of educational conferences 
held in New York City each fall since 1932 has consist- 

ently attracted the attention and support of a large number 
of educators in the eastern part of the United States. These 
conferences are planned and carried out under the joint 
auspices of the Educational Records Bureau, the Cooperative 
Test Service, the Committee on Measurement and Guidance 
of the American Council on Education, and the Commission 
on the Relation of School and College of the Progressive 
Education Association. While they are of special interest to 
members of these organizations, the meetings are attended by 
many other teachers and school administrators. 

The motif of the conferences is basically an interest in the 
individualization of education, but this theme is so broad and 
has so many ramifications that it involves in one way or an- 
other nearly every type of educational problem and commands 
the interest of persons engaged in all kinds of educational 
work. The diversity and wide appeal of the programs are 
suggested by the following tabulation of the fields from which 
the speakers for these conferences have been drawn: 
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Number 
Head, independent school 
University or college president 
Professor of education 
Instructor, independent school 
College dean 
Professor of psychology 
Superintendent of schools 
Chairman, university board of admissions............. 
Director, state testing program 
President, foundation 
Staff member, foundation 
Principal, high school 
Commissioner of education 
Assistant superintendent of schools ...............-.. 
Director, American Council on Education 
Director of Commission on Teacher Education 
Director, New York State Regents’ Inquiry 
Director of Psycho-Educational Clinic 
Director of Testing and Research Bureau 
Coordinator, Study of Secondary School Standards..... 
Research associate, university 
Professor of physics 
Professor, Institute of Child Welfare 
Editor, publishing company 
Specialist in remedial instruction 
Neuropathologist 
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Seven hundred forty-eight representatives from a total of 
four hundred nine institutions were present at the eighth edu- 
cational conference held at the Hotel Roosevelt in New York 
City on October 26th and 27th, 1939. About two-fifths of 
the group came from independent elementary and secondary 
schools, one-fourth from universities and liberal arts colleges, 
and one-fifth from public schools. Teachers colleges, state and 
federal departments of education, and various educational 
associations also contributed a considerable number of repre- 
sentatives to the meeting. 
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The conference was opened by Dean Henry Chauncey of 
Harvard College, who presided at the Thursday morning ses- 
sion. He remarked that the conferences served a very useful 
purpose in providing a forum for the presentation of the 
results of significant investigations and also for the discussion 
of controversial topics, and pointed out that the morning’s 
program provided subjects of both types. He introduced 
Eugene R. Smith, headmaster of the Beaver Country Day 
School, who spoke on ‘‘Modernizing Records for Guidance 
and Transfer.” Dr. Smith emphasized the relation of the 
records used in an institution to its philosophy of education. 
He presented examples of various records that have been 
developed in an effort to bring into practice the most modern 
thought in schools and colleges. He traced the transition 
from the former practice of mass education to the present 
tendency to give each individual the education that is appro- 
priate for him, and he showed by concrete illustrations the 
function of records in individualized education. 

During the discussion which followed the address, Dr. 
Smith stated in answer to a question concerning the variability 
among teachers in judgments of pupil behavior that his com- 
mittee had found that by carefully defining the kinds of be- 
havior and by instructing the teachers in the use of the record 
forms, it was possible to obtain judgments that were sufhf- 
ciently alike to have meaning and validity. In answer to a 
question concerning where the records could most profitably 
be kept in a fairly large school, Dr. Smith replied that there 
was no set rule but that the records should be kept in such a 
way that they are available to any members of the staff who 
have any guidance function. 

The second speaker on the Thursday morning program was 
W. H. Cowley, president of Hamilton College, who spoke on 
‘The Current College Admissions Situation.”’ He stated with 
emphasis that the unit system of admissions is dying out. He 
identified four movements which have undermined the unit 
system, including doubt on the part of people in both higher 
and secondary education concerning the intellectual validity 
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of the unit, the protests of leaders of secondary education 
against the domination of the colleges, the work of the Eight- 
Year Study of the Commission on the Relation of School and 
College of the Progressive Education Association, and demon- 
stration of the defects in the unit system by statistical research 
as exemplified by the investigation recently completed by the 
Carnegie Foundation in the state of Pennsylvania. He di- 
rected attention to the new responsibilities which the changes 
in the admissions situation were bringing to the colleges, in- 
cluding especially the need of differential curricula and the 
need of improving and applying techniques for the appraisal 
of the abilities, aptitudes, and ambitions of students. He 
showed that the changes were bringing an even greater chal- 
lenge to the secondary school, since their new freedom to 
develop their own programs requires that they carefully think 
out their objectives and provide differential instruction in con- 
sonance with these objectives. 

In the ensuing discussion, the question was raised concern- 
ing whether or not the unit system may not be the best way 
of stimulating the development of the basic skills needed for 
college work. Dr. Cowley replied that the concept of mastery 
and achievement was preferable and that tests of achievement, 
rather than merely the use of the unit system, were highly 
desirable in placing students in the college courses to which 
their abilities were best suited. 

Miss Elizabeth F. Johnson, headmistress of the Baldwin 
School, presided at the luncheon meeting on Thursday. She 
introduced Marion E. Park, president of Bryn Mawr College, 
whose subject was “Some Values of Progressive Education 
for Women.” Dr. Park first discussed the needs which the 
education of women have in common with that of men. She 
pointed out that many of the sex differences were the result 
of social suggestion and standardization and suggested that 
it was desirable that education train young men and young 
women to develop in any direction for which they have the 
ability and interest rather than to think in two separate, for- 
malized groups. She then discussed the special problems in 
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the education of women. The women’s colleges must foresee 
the special problems of the mother of children and the general 
problem of the life in which important interests and responsi- 
bilities are not unified but are very different at different times. 
The latter problem requires a building of some strong interests 
that can survive a long break in attention. Dr. Park stated 
that women students should not be taught by methods which 
make for dependence but that they should be given responsi- 
bility which will provide a rehearsal for their lives in their 
own communities. 

The chairman of the Thursday afternoon session, Stanley 
R. Yarnall, principal of the Germantown Friends School, 
opened the meeting with the remark that the program for the 
afternoon included two very important educational topics that 
were practically new. He pointed out that although we think 
of occupations as a very old subject, it is academically a very 
new subject. He then introduced Edwin A. Lee, professor 
of education, Teachers College, Columbia University, whose 
topic was “Major Problems in Occupational Adjustment.” 
Dr. Lee defined occupational adjustment as “a program the 
purpose of which is to bring about for each individual a rea- 
sonable relationship between the work that the individual 
desires to do, the work he is qualified to do, and the work 
which needs to be done.” He stated and discussed eight major 
problems of occupational adjustment. Among these problems 
were those of following the individual from the time he begins 
to think about an occupation until he is satisfactorily launched 
in one, of getting school people to accept responsibility for 
occupational adjustment, of obtaining competent personnel, of 
maintaining satisfactory relations with employers and with 
organized labor, of resolving the controversy between general 
education and vocational education, and of keeping occupa- 
tional adjustment programs on the basis of research. 

Louis C. Zahner, head of the English Department of the 
Groton School, was the second speaker on the afternoon pro- 
gram. His subject was “The Testing of Comprehension.” 
Mr. Zahner pointed out that testing influences teaching and 
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that fixed response tests may conceal a vast ingredient of sub- 
ject matter, particularly in certain fields. He outlined the 
characteristics of a field of learning to which a fixed response 
test is well adapted and indicated that the subject of mean- 
ings and comprehension is not a field of this kind. He based 
this conclusion on an exposition of the principles of language. 
Mr. Zahner urged, however, that the natural difficulties which 
confront objective tests in the field of language and meanings 
should not lead to a retreat of these tests from this field but 
that teachers and test makers should strive to develop tests 
that will overcome the difficulties by working together from 
the same basis of theory and principle. 

Dean Herbert E. Hawkes, of Columbia College, presided 
at the dinner meeting. The guest speaker was Henry M. 
Wriston, president of Brown University, whose subject was 
‘Perspective upon Education.”” Dr. Wriston discussed the 
various sham battles that have been waged in the past in the 
war upon culture and showed how the attacks upon liberal 
education have broken down. He discussed the relation of the 
modern comprehensive testing program to the revived faith 
in culture. He indicated that although testing programs have 
not made an end to educational battles, they have helped 
bring about a realization that most schools and colleges are 
aiming toward a substantial set of objectives and that, not- 
withstanding the apparent surface confusion, an effective edu- 
cational policy does exist. 

At the Friday morning session, Burton P. Fowler, head- 
master of the Tower Hill School, was chairman. The first 
address was given by Edward S. Noyes, chairman of the 
Board of Admissions of Yale University, who spoke on 
“Recent Trends in the Comprehensive Examination in Eng- 
lish.” Professor Noyes reported data showing that the reli- 
ability of the reading of the Comprehensive English exami- 
nation has been raised significantly in recent years. He then 
explained and discussed the changes in the construction and 
marking of the examination which seem to be responsible for 
the improvement in its reliability. The changes, he pointed 
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out, have been gradual and have been the result of the work 
of many persons. Professor Noyes indicated that the im- 
provement in reliability has been due in considerable measure 
to the current practice of pretesting the questions, to the great 
care that is used in training the readers of the examination, 
and to the new techniques that are employed in grading the 
examination. 

In the discussion that followed the paper, Dr. Noyes was 
asked how closely the ratings on the Comprehensive English 
examination correspond to the ratings on the scholastic apti- 
tude test. He replied that a high correlation is neither ex- 
pected nor desired because the two examinations should and 
do measure somewhat different things. 

The subject of the second speaker, Florence L. Good- 
enough, of the Institute of Child Welfare of the University 
of Minnesota, was “Can We Influence Mental Growth: A 
Critique of Recent Experiments.” In referring to the fact 
that the IQ is not always constant, Professor Goodenough 
pointed out that it is hazardous to assume a cause for lack 
of constancy because even the best of tests is not infallible 
particularly when given at an early age and because either 
the genetic constitution of a child or environmental factors 
may influence the direction and character of postnatal changes. 
She then commented on various studies in which inferences 
have been drawn relative to a causal relationship between 
changes in intelligence quotient and certain environmental 
factors. She presented a critical examination of the data in 
some of these studies and stated a strong conviction that con- 
clusions concerning the influence on the intelligence quotient 
of such environmental factors as the nursery school and the 
cultural level of foster homes should be held in abeyance 
until further evidence becomes available. 

The third speaker, A. J. Stoddard, superintendent of the 
Philadelphia Public Schools, discussed “The Selection of 
Teachers from the National Viewpoint.” Dr. Stoddard, who 
is chairman of the National Committee on Teacher Exami- 
nations, called attention to the fact that the modern curricu- 
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lum makes unusually able teachers essential and he stated 
that if schools take advantage of present conditions, it will 
be possible for them to select the very highest type of teachers 
provided the schools are able to find the means for deter- 
mining the highest type among the many candidates for 
teaching work. He then explained the plan of the National 
Committee for the use of objective examinations to help in 
the appraisal of candidates for teaching positions. A set of 
comprehensive objective examinations for teachers is now be- 
ing constructed under the direction of the committee by the 
Cooperative Test Service of the American Council on Edu- 
cation with the aid of a subvention from the Carnegie Founda- 
tion. The examinations will be used for the first time in 
selected centers in the spring of 1940. The examinations will 
be designed to test teachers’ equipment from the standpoint 
of facts, knowledge, and skills and will be supplemented by 
other selection procedures to be determined and applied by 
each local school system. 

During the extended discussion which followed the paper, 
Dr. Stoddard was asked whether or not the examinations 
would extend to teacher training institutions so that they may 
measure their products. He replied that they would be used 
in this way and that a large number of teacher training insti- 
tutions were planning to have their senior class take the 
examinations this year. In answer to a question concerning 
what precaution the committee is taking to make the tests 
valid, Dr. Stoddard stated that the tests are being constructed 
to meet the demands of the field. The questions are being 
sent for criticism to hundreds of teachers over the United 
States and many courses of study are being examined, par- 
ticularly those in cities that are reputed to be forward looking 
in their work. Every attempt is being made to validate the 
tests from the standpoint of best practices. 

Milton E. Loomis, associate commissioner for Higher 
Education in the State of New York, was chairman of the 
Friday luncheon meeting. In his opening remarks, he praised 
the services of Miss Grace Turner, who had so efficiently 
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represented the sponsoring organizations in arranging the 
many details of the conference. Dr. Loomis prefaced his 
introduction of the speaker with a statement that it is en- 
couraging that after many years of talking about training for 
the public service, it is possible at last to link the idea of edu- 
cation with the public service. He stated that possibly we 
have lost sight of the fact that what the public service really 
needs is educated public servants and he called attention to 
the responsibility of the educational institutions to send into 
the public service people who are able to make of that service 
a real career. He then introduced Luther H. Gulick, pro- 
fessor of municipal science and administration at Columbia 
University and director of the New York State Regents’ In- 
quiry, who spoke on ‘“‘Education and the Future of the Public 
Service.” Professor Gulick called attention to the fact that 
one of the important changes in America in recent years has 
been the development of public service as a major human ac- 
tivity. He showed that this greatly expanded public service 
was gradually being placed on a merit basis and that the adop- 
tion of the merit system makes training one of the most im- 
portant factors which is utilized in the selection of personnel. 
He pointed out the dangers that schools would train for posi- 
tions that do not exist and that personnel officers would 
demand training that is too specific. The need is to train and 
select persons for the public service who will have the ability 
to advance and build a career in that service. This calls for 
cooperative planning between educational institutions and civil 
service and personnel officials and administrators. 

In the course of the discussion which followed the address, 
a question was raised concerning where the liberal arts train- 
ing fits into the training for the public service. Dr. Gulick 
replied that it was his own belief that the broad training 
should come first and that near the end, the student should 
have a very short course devoted to some practical phases of 
the work he is planning to enter. He stated further that he 
felt that in many fields of work the individual should be taken 
into the public service solely on the basis of his broad courses 
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and on the basis of evidence of the promise of growth. This 
implies that the public service, and the private service as well, 
should consider developing an apprentice system so that after 
appointment there will be training in the service for indi- 
viduals who have been selected on the basis of promise and 
broad knowledge. 

Hart Fessenden, headmaster of the Fessenden School, was 
chairman at the last session of the conference held on Friday 
afternoon. The subject of the first speaker, Robert G. Bern- 
reuter, associate professor and director of the Psycho-Educa- 
tional Clinic, Pennsylvania State College, was “The Present 
Status of Personality Trait Tests.” Professor Bernreuter 
defined one’s personality as the effect that he has upon the 
people with whom he has associated. He discussed various 
characteristics which contribute to personality, including phy- 
sique, intelligence, knowledge, skills, emotional characteristics, 
and sociability. He pointed out that one’s personality de- 
pends upon the characteristics of his associates as well as upon 
his own characteristics. He then discussed various techniques 
in the appraisal of personality, including personality tests and 
observation. He warned that tests would not answer all the 
questions about the development of the personality of indi- 
viduals but he expressed a conviction that they may be of 
some help and gave illustrations from his clinical experience 
to show some of the uses of personality tests. 

The second speaker, Robert N. Hilkert, director of the 
Department of Personnel Study of the Hill School, discussed 
“Parents and Cumulative Records.” Mr. Hilkert brought 
out the fact that while cumulative records have many values 
for guidance within the school, potentially one of their most 
important uses is in informing parents about the progress of 
their children. He presented a convincing argument in favor 
of showing and explaining cumulative records to parents in 
conference. He urged that parents have a right to see not 
merely the objective test history but the entire cumulative 
record, including the personality data. He developed the 
theme that parents can understand even the more compli- 
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cated parts of the cumulative record and that they are aided 
in making plans for their child’s future by having presented 
to them all the cumulative data which the school has collected. 

One of the points brought out in the lively discussion near 
the close of the session was that an attempt should be made 
to furnish cumulative record information to all parents, not 
merely to those whose children present some type of problem. 

The annual Conference of State Testing Leaders, a meeting 
which is sponsored by the Committee on Measurement and 
Guidance of the American Council on Education, was held on 
Saturday, October 28, following the Joint Educational Con- 
ference. The following speakers and subjects were included 
in the program: H. H. Remmers, Purdue University, Intro- 
ductory Remarks; J. U. Yarborough, Southern Methodist 
University, ‘Limitations of Statewide Testing Programs’’; 
H. T. Manuel, University of Texas, ‘Possibilities and Limi- 
tations of Regional and National Testing Programs”; J. E. 
Crissy, University of New Hampshire, “The Testing Pro- 
gram of the Joint Committee of the Business Education Coun- 
cil and National Office Managers Association”; E. F. Lind- 
quist, State University of Iowa, and Eleroy L. Stromberg, 
Oklahoma Agricultural and Mechanical College, “The Possi- 
bilities and Limitations of Interchange of Test Materials’’; 
Herbert A. Toops, Ohio State University, ““A Proposal for a 
‘Standard Million’ in Compiling Norms”; John M. Stalnaker, 
Princeton University, “Factor Analysis from the Point of 
View of the Practical Test Man”; John C. Flanagan, Co- 
operative Test Service, “Some Implications of Scaled Scores’”’ ; 
and E. C. Schroedel, International Business Machines Corpo- 
ration, ““The Present Status of Machine Scoring and Machine 
Item Analysis.” A summary of the various papers will be 
found in a section of this report. 

In accordance with the practice of preceding years, the 
annual meetings of the standing committees of the Educa- 
tional Records Bureau were held in connection with the Joint 
Educational Conference. The committees include the Inde- 
pendent Schools Advisory Committee, the Committee on 
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School and College Relations, the Committee on Relations 
between Elementary and Secondary Schools, the Committee 
on Tests and Measurements, and the Public Schools Advisory 
Committee. Among the more important matters brought up 
for discussion in these committees were the work of the new 
subcommittees on Test Construction, a printed report on the 
Public School Demonstration Project in Educational Guidance, 
and various technical problems involved in the reporting of 
test results by the Bureau. The work of these committees is 
assuming an increasingly important place in the total program 
of the Educational Records Bureau, and it is believed that all 
the Bureau’s member schools will be interested in the minutes 
of the annual meetings, which comprise the last section of the 
present report. 








Modernizing Records for Guidance 
and Transfer 


By EUGENE R. SMITH 


\ ' Y HEN I began to go over the available material 
about records for such an audience as this, my great 
problem became one of choosing that which would 

be really significant. This audience is composed of people 
who are interested in all levels of education, from that of 
nursery schools through graduate work in college. I should 
like the things I have to say about records to concern to 
some extent this whole educational range. 

I have decided therefore that the most important single 
thing I can bring to you this morning is a discussion of the 
relation of records to philosophy of education, with examples 
of various records that have been worked out in the attempt 
to bring the most modern thought on this subject into action 
in both schools and colleges. 

Records have not been considered particularly important 
in school work. On the whole, they have simply been a 
method of convenient bookkeeping. In developing American 
education, the first need was to see that all the young people 
of the country had an education, which forced the schools 
into what might be called a mass production approach. You 
may quite well say that there has been no time when all 
American educators believed in mass education and, of course, 
that is true. I am, however, painting in rather large brush 
strokes rather than attempting to etch. 

It is true that on the whole, we were concerned with the 
process of giving all our young people an education including 
at least the most important fundamentals. In doing that we 
inevitably—partly because of expense, somewhat from igno- 
rance, partly because we did not have enough trained teach- 
ers—worked with large groups, used standardized material 
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and therefore emphasized the mathematical, bookkeeping kind 
of information about the boys and girls. 

The common type of teachers’ book in past years and the 
type that is still sold by the thousands today is one that has 
spaces in it for each day of the month and a method of 
recording absence, tardiness, a mark for each day, an exami- 
nation mark, and the mark at the end of the period. That 
has been the commonly accepted type, and it is a perfectly 
logical, simple bookkeeping device for the kind of education 
in which the school is attempting to keep a record of marks, 
the main purposes of which are to spur the student, and to 
determine whether or not he is to be promoted. 

It seems to me one might very well consider that this type 
of education and this type of recording are characterized and 
related by the fact that they deal with accumulated marks and 
credits and emphasize terminal points. Such schooling is in 
very sharp contrast with the kind that regards the whole 
range of education as a developmental process in which there 
is no terminal point where one can wipe the slate clean by say- 
ing that there is a certain amount accumulated with which the 
student is no longer particularly concerned. 

The philosophy of education quite generally accepted 
today takes this second view of a continuing process in which 
the school’s concern is with the development of the individual, 
rather than with bookkeeping. 

I am willing to concede that at no time have we been with- 
out those who have seen this latter view very clearly and have 
tried to use it. Nevertheless, I do contend that so long as 
schools were, or are, satisfied to work on the mass production 
basis, with emphasis on marking, on accumulated credits, and 
on terminal points, they were, or are, also quite well satisfied 
with records which give a convenient bookeeping method of 
saying that a pupil has received certain marks, or has accumu- 
lated certain units of credit. This may have some value but 
the value decreases rapidly as the type of education changes. 

If I may put the philosophy of education that I believe is 
increasingly accepted at the present time into a few words, 
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unsatisfactory as any such definition will be, I should say that 
it is based on this point I have already made, that of a con- 
tinuing process, with recognition of the good of the individual, 
and through him of the group, as the primary purpose rather 
than the attainment of any standardized type of expectation. 

The moment we recognize that the individual is the center 
of our purpose our problem becomes that of finding out what 
can be done for each one. The development of the individual 
both for his own success and satisfaction, and for the good of 
the community, becomes the important aim and the continuity 
of the process that is dealing with individuals becomes the 
corollary. On the basis of these two fundamentals the United 
States has been and is gradually modifying its philosophy of 
education. Perhaps this is not so much a modification of 
philosophy as it is of method, but whether it be philosophy 
or method, the fact remains that we are concerned very much 
less with whether a pupil accomplishes certain prescriptions, 
and very much more with whether he is doing and is having 
done for him those things that are necessary for his own 
growth. As a consequence we are concerned with records that 
tell the story of his development from the earliest point to 
the end of his time in our educational institutions. Perhaps 
later we may be better able to add “on into life.” 

This changing educational emphasis requires records of a 
totally different character from those that have been used 
before. It presents problems of a very serious nature to any- 
one who is attempting to study the individual, and to record 
those things that are important about him. I go back over 
and over again to the saying that is attributed to Professor 
Morrison of the University of Chicago, that the teacher of 
the future will spend half of his working time finding out as 
much as possible about his pupils and the other half of the 
time doing the things that he has found to be necessary. We 
do not have to agree with the half-and-half division of time, 
but I think we can agree with the philosophy of trying to find 
out what to do before we go ahead and do something. 

Let us look at a very practical illustration of this point, one 
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in spelling. When many of us were in school, the teacher gave 
us spelling lessons that had a certain number of words in 
them. We were all required to study the whole list of words 
and eventually we were tested on the list. That was an 
approved, a general method at that time. The change to a 
process of analysis is shown very simply, I think, by what is 
done in so many schools today, where before the words are 
studied the pupils are asked to attempt to spell the list, and 
each one thus has picked out for him the words he does not 
know how to spell. A pupil who knows how to spell ten of a 
list of twenty to be done by the class does not study every one 
of the twenty with equal attention but instead concentrates on 
the ten he does not know. And some other child may also 
know ten but have quite a different list that he does not know. 
He will then concentrate on his own ten. By successive test- 
ings over a period of time, the school will find out whether 
the apparent fact that the child knew ten words was an actual 
fact or whether he had good luck in spelling some of the 
words, because I suppose many of you have found out that it 
is not unusual for a child at certain ages to spell the same 
word three different ways on the same page. 

This is an approach by which the teacher finds out, first, 
what each child needs in a spelling lesson, and then concen- 
trates on attempting to fill his particular need without refer- 
ence to anyone else’s need. It illustrates the point I have in 
mind, that through the whole process of education at the 
present time, the first step is to find out what each one needs 
and what each one can do, at the stage in question, and then 
to follow the career of each pupil with a continuing process 
of meeting his needs, of making use of his powers, of filling 
those gaps that can be filled, of avoiding, even, those places 
where there is no prospect that it will be possible, or worth- 
while, to do anything for him. 

For this kind of education, records become increasingly 
important because they must be a story of growth. Their im- 
portance is basically twofold. They must be an adequate story 
of the growth of the child, usable for guidance, and therefore 








Modernizing Records for Guidance and Transfer 21 


a basis for transfer from class to class or from institution to 
institution. The title of my talk this morning was chosen to 
bring out the two most important uses of recording forms in 
this newer approach to education: guidance, doing each day 
the right thing for each individual pupil, and transfer, the 
passing on of information so that education becomes a con- 
tinuous process. 

Where can one get the information to do this? It is essen- 
tial that for guidance and transfer the information be accurate 
and adequate. It comes increasingly from various types of 
evaluation that are taking on tremendous importance, evalu- 
ation that supplements the observation of the teacher with 
information that has considerable objectivity. 

There has been great development in tests of all kinds, 
from the old type where they were entirely the teacher’s 
creation, where the judgment in regard to them was almost 
entirely subjective, where there was no comparability, through 
tests of subject matter that have the objectivity and compara- 
bility that has proved so valuable, to tests of ability of various 
kinds, and over-all tests of specific abilities and skills that now 
are showing such promise. L. L. Thurstone’s test of primary 
abilities is a recent example of the latest types as are tests of 
the type that Ralph Tyler and his assistants in the Progressive 
Education study are making and using in the schools. In some 
of these the reasoning process is broken down into various 
parts and the pupil’s development is judged irrespective of 
where he obtained that development; that is, one is not con- 
cerned primarily in those tests with how much a pupil knows 
about a particular subject, but does care very greatly whether 
he knows how to interpret and use the facts given him, or 
whether he can apply a generalization in a situation that is 
new to him. In other words, one tries to find out whether the 
pupil is learning to use those processes of thinking that are 
certain to be all-important in his whole life. 

All the results of testing and many other types of infor- 
mation from evaluation such as is obtained, for example, from 
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surveys of the reading done by each pupil, can be made part 
of a record. 

But the other part of the story, which I am convinced is 
no less important, is in the information that comes from the 
observation of trained, experienced, thoughtful teachers, for 
the teacher is still an important factor in any educational 
institution, in fact is the heart of the institution. I do not like 
to have people tell me that after all the teacher’s observa- 
tions are entirely subjective, and so of doubtful value. I don’t 
believe it for a moment. If a teacher is capable and if he is 
kept awake to the necessity of making careful judgments, then 
his observations are founded on evidence that is definitely ob- 
jective. Dangers inherent in a teacher’s judgments should be 
pointed out, such as that of the halo effect by which because 
a boy is a good athlete and a fine fellow he may be given 
credit for all the good qualities that anybody can have, when, 
as a matter of fact, he may have very great lacks which the 
teacher ought to know and which it is no kindness to the boy 
to ignore. 

True, a teacher’s judgment is affected by the teacher’s per- 
sonality and thinking and therefore takes on some degree of 
subjectivity, but I believe the evidence shows that the judg- 
ment of a competent, well-trained, experienced person who is 
trying to deal in terms of the development of an individual, 
is a very valuable contribution to the evidence that is accumu- 
lated. A teacher sees behavior day in and day out and there 
is nothing better by which a person can be judged than by what 
that person actually does in all kinds of situations. 

A set of record forms then should have on them a place for 
all types of comparable material gotten from various kinds 
of evaluation, and should have ample opportunity for each 
teacher, each executive, everyone who knows about the pupil 
through observation of behavior, to contribute whatever will 
throw light on that person as a living individual, going through 
an unbroken, continuous development. 

If records are to do all that, they cannot be simple book- 
keeping forms on which a few mathematical symbols are 
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entered. I have seen some horrible examples in relation to 
this. I presume some of you have heard me tell of one that 
I am going to repeat here. 

I was once in the class of a very well-known teacher of 
English, a man with quite a reputation in that field. He did 
realize the fact that a teacher ought not to spend all of his 
time putting down estimates about the pupils, so he saved 
his time by appointing a pupil monitor to do the recording. 
Then, after a boy answered, he told this monitor what to put 
down opposite that boy’s name as a part of the boy’s record. 

The day I was there, he had a group of high school boys 
who had been told to read a certain part of Robinson Crusoe 
the night before. I don’t quite know why they had read 
Robinson Crusoe, and I know still less why he was so excited 
about the parrot, but the question he was asking the class 
when I went in was this: “‘What was the first thing Robinson 
Crusoe taught his parrot to say?” 

The first boy didn’t know, so the teacher told the monitor 
to put down a zero. The second boy didn’t know either and 
he too received a zero. I think half a dozen boys had zeros 
put down for the day because they did not know the first thing 
the parrot said. Some boy made a guess which was pretty 
good and was given an 8 while the boy who finally gave the 
right answer was given 10. 

Of course, that is a very extreme case, but it does illustrate 
a common desire to have something which is definite and which 
can be added up and divided. 

I taught in a school at one time where the teachers were 
required to put down exact units for everything a pupil did. 
One couldn’t even be satisfied with 70 or 80 or A or B; the 
mark must be in single units or even fractions. Then the school 
averaged the marks every so often to hundredths of one per 
cent. It has been thoroughly established that no teacher can 
estimate any closer than in groups of 10 per cent in regard to 
pupils’ performances, and consequently we were committing 
the mathematical sin of giving results supposedly one thousand 
times as accurate as the data on which they were founded. To 
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my astonishment and distress I found last year that there were 
schools still doing this very thing. Some schools still are send- 
ing reports to parents and using them for other purposes 
when they are false because they pretend to be many times as 
accurate as they can possibly be statistically. 

In contrast to that, various committees have been at work 
for several years trying to devise forms that will meet the 
criteria that I have given; that is, to prepare records that can 
become continuing reports of a pupil’s all-around development. 

Before considering these forms, however, I am going to 
suggest another value of records, namely, to influence the 
teacher to analyse and develop his purposes. I heard quite 
an eminent teacher at one time say that after many years of 
teaching he had been very much surprised to find that there 
were purposes in what he was doing. He said he had taught 
the subject for all those years, but his only reason was that 
he was trained to teach it and so he did. The thought that 
there were purposes other than knowledge of subject matter 
involved in teaching and changes which would be brought 
about in his students which he should observe, had never come 
to his mind. 

For the past six years, approximately, these different groups 
of school and college teachers and executives of which I have 
spoken have been working in their attempt to devise forms 
that can be used for recording for guidance and for transfer, 
and little by little, it has developed that the mere study of 
recording has brought to practically everyone concerned a 
more complete conception of the purposes of teaching. The 
teachers examining the problem have analyzed their intent in 
working with their classes to a degree that I have never seen 
done before. 


Very much the same result has come about in the work that 
Ralph Tyler has been doing in evaluation where he has asked 
teachers to decide what should be evaluated in regard to the 
work they are doing. They have been forced, for evaluation 
and recording both, to decide what they are trying to do, what 
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they hope to accomplish, what changes they expect to bring 
about in their students. 

I was talking with the head of a department of one of our 
major colleges some years back. He was an intimate friend 
of mine so I could talk with him freely. I said to him, “Why 
aren’t you interested in teaching?” He answered, “What do 
you mean by my not being interested in teaching?” 

I said, ‘I mean just what I say. I don’t think you have the 
slightest interest in teaching.” 

He thought for a moment and then said, ‘Do I know my 
stuff?” I had to reply that he did know his field. 

“Well,” he said, “I give it to them; if they don’t get it, 
that’s their lookout.” 

There again, I am taking an extreme case, and yet not an 
unknown case today in our schools and colleges. We could 
go out tomorrow and within a very short range in an institu- 
tion of almost any degree of advancement, from the elemen- 
tary school up, we could find many teachers whose attitude is 
much the same. And for that type of teacher, something must 
be done to change the viewpoint. 

The secondary purpose, then, of any recording material 
seems to me to be to have an impact on the teachers, so that 
they are no longer satisfied to teach with the thought that when 
they have a certain amount of material, their duty is done 
when they present it. 

I should be thoroughly dissatisfied with any system of re- 
cording that did not stimulate thinking on the part of the 
teachers, thinking of their purposes, of what would give bet- 
ter results in making changes that were worthwhile in the 
students who came to them, and in making their contributions 
toward the total purpose of the institution of which they were 
a part. 

I am going to start, not by telling you about a form, but by 
showing you a form in use. Recently I was asked to tell a new 
teacher who happens to be a member of a college faculty doing 
part-time work in my own school, something about a girl in 
his class whom he wished to understand better. I read to him 
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the pupil’s behavior description record, which I shall read to 
you as I read it to him, giving simply an off-hand analysis of 
the record without going into too much detail. It will, I think, 
point to some of the conclusions and some of the explanations 
I am going to make from now on. 


This girl is on the whole industrious and responsible. She reaches 
in some of her work the point where she does not need to be told what 
to do, but goes beyond the requirements of the teacher in her desire to 
get as much as she can from the opportunity and to make any contribu- 
tions she can to her classes. However, she is at times a little tempera- 
mental and some work that she likes less than other kinds may not be 
so completely done. 

She is judged by all her teachers to have a good deal of creativeness 
and originality. The least favorable judgment given by anybody is that 
she is promising in this quality, and the highest judgments which are 
given by any of her teachers—and there is a certain significance in which 
ones give those judgments—is that her whole attitude toward everything 
she does is creative, that she puts into all activities something original. 

Her influence in the group is distinctly constructive, and she has a 
good deal of influence. I am not using the word “leadership,” you 
understand. She has a very strong constructive influence. Her opinions 
are respected and therefore the class is the better for having that pupil 
in the group. The one place where that is not strictly true is in the part 
of the school day given to physical education. She is not particularly 
vigorous, and therefore does not respond well to that kind of activity, so 
she is likely to drop out of a situation sometimes when she should take 
part in it. 

She has a highly inquiring mind on the whole. Practically every 
teacher judges her to be one who responds with deep interest to any 
intellectual stimulus. She varies a good deal, however, in openminded- 
ness. She has certain areas of fixation where, because of her past experi- 
ence or prejudice developed from family or otherwise, she thinks with 
a certain emotional set that does not always make it easy to change her 
mind. She intends to be openminded, and if you work with her for any 
considerable length of time you do succeed in obtaining openmindedness 
even though there is some rigidity at the start. 

This pupil has considerable ability to analyse but she does not always 
meet every situation from the analytical standpoint. She has an artistic 
bent that makes it likely that in some situations her emotions will enter 
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in rather strongly, but when she faces the need for analysis she usually 
goes through with it rather well. 

She is definitely concerned for the good of her group; that is, she 
thinks beyond her own selfish interest to a degree that means that her 
social contribution is a thoughtful one. She is very responsive emotion- 
ally. She responds to ideas quite highly, always to beauty of various 
kinds, and to a degree even to orderliness and to difficulty; that is, she 
will respond if a difficulty is pointed out to her as one worth overcoming. 

She is not physically vigorous, which has to be taken into account in 
what she is allowed to do or urged to do, but she has a high degree 
of self-reliance, of assurance in various situations, and she shows good 
emotional control despite the fact that she is strongly emotional. 

This pupil has had serious family unhappiness within a short time 
and has gone through distinct and powerful emotional upsets. She has 
controlled herself remarkably, but undoubtedly has suffered somewhat 
perhaps from overcontrol. She is secure in her social situation, judged 
of course for her age; that is, she has no apparent feeling of insecurity. 
She is accepted and has a distinct place in her group. 

She is definitely purposeful. She knows what she wants and why she 
wants it, and is always moving toward something far enough ahead to 
be a worthwhile long-time purpose. 

Her work habits are on the whole quite highly effective, though they 
differ somewhat in different fields. They are never less than reasonably 
adequate for a girl of her age. 


I am giving you this description by reading the abbreviated 
records made by a group of teachers who worked with the 
pupil last year. There is not added the intimate information 
to be written in paragraphs, but I think you will concede that 
the picture of that young person is such that it would be very 
valuable for anyone who was to work with her. 

A teacher who knows the child perhaps better than anybody 
else in the school was in the room when I read from the card 
as I have read to you. I asked the teacher if I had given a 
fair picture and she replied, ‘‘It is the most remarkable picture 
anybody could give of that particular person.”’ 

Whether or not that teacher is right I do believe that the 
judgment of eight people brought together and focused, as 
this record does it, gives a basis for understanding the person- 
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ality of the pupil that can be used for guidance or transfer or 
any other purpose for which records are of value. 

Having given you this illustration I want to tell a little 
about where the form came from. In the Eight-Year Study 
of the Progressive Education Association, one of the first 
committees set up was the one on evaluation and recording, 
because it was recognized at once that any experiment which 
asked the colleges to withdraw examinations and specific re- 
quirements must supplement information that could be given 
in the past by more valuable and more complete information 
from the schools, and that the schools must therefore learn 
how to collect such information, how to record it, and how to 
present it to the colleges. 

The committee started with the assignment of finding a way 
to get information about personality. The first thing it did 
was to see what other people had done. It found that various 
institutions and organizations had become increasingly con- 
cerned about traits and characteristics and that all sorts of 
words were being used to define them. 

The first survey showed over a hundred and fifty different 
trait names in use in schools, colleges and social institutions. 
A later study brought out about two hundred and sixty trait 
names, usually undefined and unanalyzed, but showing the tre- 
mendous importance people were beginning to give to a study 
of individuality. 

I could expand almost indefinitely on this, but I think it is 
enough to say that a distinguished group of people, school and 
college executives, psychologists, and others worked together 
for a term of years, preparing successive editions of the 
material that is on this card, trying to find out which ones of 
these two hundred and sixty different trait names were worth 
using, how they could be analyzed so teachers could make 
judgments about them, and how they could be recorded in 
such form that the total judgments or teachers would take on 
meaning. The result has been this card and the manual which 
is published with it. 

Such a record becomes one source of information about a 
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pupil. A second source based on teachers’ observations ought 
to come particularly from subject-matter teachers or others 
who are dealing with the pupils in particular situations. To 
make this possible, a whole group of committees has been at 
work. 

At first, four committees composed of teachers of mathe- 
matics, science, social studies, and English studied the problem. 
I have never had a more thrilling experience than I had when 
these four committees reached the point where they insisted 
on pooling their thinking about all sorts of matters. For in- 
stance, members of the mathematics committee said that they 
needed to discuss with the social studies teachers because there 
were so many elements in the mathematics situations in which 
teachers of the social studies had had more experience than 
they. The mathematics and science groups met together over 
and over again. All four of those committees spent almost 
half their time meeting as a whole, the rest meeting sepa- 
rately or in smaller combinations to consider their particular 
problems. 

The results seem very significant, and yet I am much wor- 
ried about them. The reason why I am worried is that every 
department that has tried to work out a formula to show what 
ought to be known about its students wants to know more 
than the teacher has time to put down. It is, however, the 
best possible indication of the interest that is being aroused 
in teachers by this forward-looking type of recording. They 
wish to know so much about what changes are coming about 
in their students, with the “why” emphasized as well as the 
“what.” 

I am now going to read to you quickly part of what the 
English teachers put on their cards in their attempt to meet 
this need. They listed the following as matters about which 
they must know: 

“Techniques and skills: Library skills, ability to gather and 
record information, ability to evaluate material, and ability 
to organize material. 

“Work habits and study skills: Skill in obtaining informa- 
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tion other than from books’’—and I contend, ladies and gentle- 
men, that when an English group puts that in, its members 
have begun to think—and “skill in use of varying reading 
techniques.” We used to think the school taught a child to 
read in the first and second grades and then the job was 
done. Teaching reading has proved instead to be a continu- 
ing process. Schools are teaching reading all the way through 
and even in colleges the teaching continues. 

“Ability to present the ideas of another through such means 
as précis and paraphrase. Ability to communicate one’s own 
thought clearly and effectively, orally or in written form. The 
mechanics of speech and the mechanics of writing,” with a 
place to indicate serious weaknesses. 

“Creative expression: Draws on his own experience for 
material, clarifies his own interpretations by detail and sense 
impressions. Evidence of creative ability in writing. The 
amount of writing he does. Indicate the variety of forms 
used, such as essay, verse, story and so forth. 

“Understanding and appreciation of literature: Shows 
insight into implicit as well as explicit. Shows insight into 
motives. Is critical of fidelity to experience. Finds clarifica- 
tion of his own experiences in literature. Finds in literature 
a means of widening horizons.’”’ And so forth. 

I cannot take the time to go into all the details but I must 
speak of some other features. There is a place where the 
reading record can be kept and analyzed. Every one of 
the subject groups came to the need of studying personality 
in the way I have already indicated, and put it on the card. 
They also left ample place for objective evaluation material, 
feeling that the teacher should know and should use any infor- 
mation that could be obtained to supplement the teacher's 
observation and the teacher’s thinking. Large spaces were left 
for the teacher to write about a pupil’s significant interests, 
particular activities and accomplishments, special abilities, 
significant limitations and general comment. 

I am not presenting this record or any other as perfect or 
even saying that any one form is the best that has ever been 
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done, though I think these have had more continuous and more 
scientific study than has been given to any other group of 
records. I do believe that they indicate the trend of present 
thought, the direction in which we ought to be moving, and 
that they therefore are deserving of study. 

My time is almost up and I must speak of a very important 
phase of recording, the transfer form from school to college. 
One of these committees gathered all of the widely used col- 
lege entrance blanks of the country and also asked a large 
number of schools to tell what information about their pupils 
they had that was significant and that ought to be reported 
to college. 

The college material was analyzed to show what was 
wanted by every college, what by perhaps 95 per cent of the 
colleges, and so on down to what only two or three colleges 
out of some hundreds wished to have. From this knowledge 
about the colleges and from the information obtained from 
the schools, there was developed a form of transfer which is 
being used now in the Eight-Year Study. 

I think this form is particularly worthy of your examina- 
tion. It attempts to get away from too positive dependence 
on statements about marks and credits in the past and tries to 
pool, instead, the thinking of all of those in the school who 
can contribute information about a pupil so as to estimate the 
degree of development and of promise for the future that 
the pupil has reached. It has ample space for the recording 
of evaluation material, for tests of all kinds, even including 
space for the analysis made from such tests as the Tyler tests 
and the Thurstone test, where one cannot at present give 
figures but must analyze the picture of the pupil shown by the 
battery of tests. 

It also has a place where one can record the information 
about personality, but for those who do not wish to use any 
sort of classifications in regard to personality, and for those 
who wish to supplement this information, it provides ample 
place for writing fully about the pupil. It also gives oppor- 
tunity for recording interests, ability, experiences, and any 
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other facts that are significant in completing the description 
of a human being. 

It is my belief that we are at a very important, not cross- 
roads, but stage of development in regard to the relation of 
school and college. Many of the investigations of the past 
have shown with a good deal of definiteness that there is no 
sacred pattern of subject matter preparation for college. The 
Eight-Year Study is, I am certain, going to give added em- 
phasis to this by a tremendous amount of proof that any 
pattern of subject matter that has continuity and is well 
done prepares a student having the necessary ability for 
advanced study. If this is true, the colleges, in their attempt 
to reach more intelligent articulation with the schools will 
continue to increase the flexibility of the step from school to 
college. I think one of the ways in which they will do this 
will be in decreasing general prescription, perhaps to only an 
English requirement, and dealing much more in specific and 
honest prerequisites for particular choices among the college 
courses. I realize that I am making a prophecy, which is 
always dangerous, but [ am so sure that schools and colleges 
together are searching for the continuity in education of which 
I have said so much, and for the flexibility that will best serve 
each individual that they must inevitably come eventually to 
such an ideal. When that comes I believe that pupils will 
quite generally be taken into college without the formal mathe- 
matics, if they have demonstrated abilities in other fields that 
justify their doing college work in those fields, and that there 
will be freedom for pupils to go to college with less foreign 
language study than now, or even none, its requirement re- 
maining only as a prerequisite for courses for which it can be 
shown to be really necessary. 

If I am at all right in this, and so many colleges have made 
distinct steps toward greater flexibility in the last few years 
that one can hardly doubt the type of thinking they are doing, 
it becomes absolutely essential that the schools shall have more 
knowledge about the young people with whom they are work- 
ing. This means that they should have better testing programs, 
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that their records should be complete studies of the pupils at 
every stage of development, that the predictive value of their 
records should be much greater than it is now, that the whole 
philosophy of education should be bound up in what is on file 
in the school office, obtained as a result of the study of the 
boys and girls and serving the purposes of guidance in 
the school and information to send to the college for use 
in deciding admission and in continuing guidance. This will 
require still other forms, such as those for reports to the home 
and for cumulative office records. Groups are now at work on 
these and others so that complete interrelated sets will soon 
be available. 

I should like to leave the one thought with you that records 
are no longer routine matters. They are living, exciting 
stories about living, exciting boys and girls. No one type of 
record is perfect, but every record should move in the direc- 
tion of becoming such a living document. If we achieve that, 
education will articulate into a continuous process. As pupils 
move on from year to year schools will send with them a study 
of their strengths, their weaknesses, their needs, of all that 
makes them real persons, and therefore at every stage educa- 
tional institutions will save the loss that comes from going 
back and starting again, or never starting at all, and instead 
will be able to concentrate on the real process of education, 
on understanding and doing everything possible for each one 
of their pupils, both for their individual growth and for their 
value to the community. 











The Current College Admissions 


Situation 
By W. H. COWLEY 


N THIS paper I discuss three topics: (1) the status of 
] the unit system of admissions, (2) the new responsi- 

bilities of the colleges, and (3) the challenge to the sec- 
ondary schools. Without further introduction I proceed. 


STATUS OF THE UNIT SYSTEM OF ADMISSIONS 


One may summarize the status of the unit system of admis- 
sions in a sentence: the unit system is on the way out; it’s dying; 
soon it will be dead, and few will mourn at its funeral. 

I am, of course, making no startling announcement to this 
audience. You who have the energy and interest to attend 
such conferences as this have long been aware of the fatal ill- 
ness of the system, and indeed many of you have fed it the 
poison potions that have brought its end so near. You have 
not caused the illness, but as humanitarians you have mercifully 
been practicing preliminary euthanasia. 

Throughout the colleges of the country, however, scores of 
administrators and hundreds, if not thousands, of professors 
are serenely unaware of the fatal malady of this guardian of 
academic respectability, this supreme protector of ‘‘standards,”’ 
this alleged Archangel Michael of American higher education. 
It is in point, therefore, to review its rise and decline so that 
the uninformed as well as the informed may more adequately 
meet the problems which we now face. 

First, a little of the history of the unit system. During the 
last two decades of the nineteenth century colleges were 
founded in such large numbers and graduate schools began to 
become so important that three insistent problems demanded 
solutions: first, the question of what constituted adequate 
preparation for college; second, the problem of stamping out 
diploma mills and low-standard colleges; and third, the tech- 


34 


The Current College Admissions Situation 35 


nique of transferring credits from school to school, school to 
college, and college to graduate school. For years the chief- 
tains of higher education of those days—notably Charles W. 
Eliot and Nicholas Murray Butler—wrestled with these 
problems, and in 1909 the National Conference Board pro- 
duced the unit system as the Q. E. D. of them all. The 
definition of the unit announced by the board and promptly 


adopted by its important constituent organizations reads as 
follows: 


A unit represents a year’s study in any subject in a secondary school, 
constituting approximately a quarter of a full year’s work. This 
statement is designed to afford a standard of measurement for the 
work done in secondary schools. It takes the four-year high school 
courses as a basis, and assumes that the length of the school year is 
from thirty-six to forty weeks, that a period is from forty to sixty 
minutes in length, and that the study is pursued for four or five periods 
a week; but, under ordinary circumstances, a satisfactory year’s work 
in any subject cannot be accomplished in less than one hundred and 
twenty sixty-minute hours or their equivalent. Schools organized 
on any other than a four-year basis can, nevertheless, estimate their 
work in terms of this unit. 


Thus was the so-called “Carnegie Unit” established. It 
should not, of course, have been called the Carnegie Unit since 
the Carnegie Foundation was only the midwife at its birth. 
Its father, like the father of Xanthus, was the wind—in this 
case the wind of current educational problems—its mother the 
National Conference Board. Strictly speaking, the unit was 
never really born. It evolved over three decades and finally 
took definitive form. There had been chaos, and many peo- 
ple worked to bring about order. Cooperatively they pro- 
duced the unit and the unit system. Thus they attempted to 
solve a problem that had been troubling educators for over a 
score of years. 

They did not, however, solve the problem. Even while 
they had been hard at work seeking a solution, the nature of 
the problem subtly changed. We have only during recent 
years been aware of just how it changed, but we know now 
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that, to borrow a phrase from Bernard Shaw, they were driv- 
ing in the tacks where the carpet used to be. 

Less than two years after the official establishment of the 
unit, Harvard began to abandon it by the adoption of the ‘‘new 
plan’”’ of admissions under which students, instead of collecting 
units in a piecemeal fashion over the four secondary school 
years, took examinations in four representative subjects. In 
the words of President Lowell the new plan was an effort “‘to 
get an impression of the individual as he stands, rather than of 
the instruction through which he has been.”’ 

I need not take the time to review the spread of the point 
of view behind the new plan. Rather I should like to identify 
four movements which have undermined the unit system and 
which have brought its final abandonment close at hand. 

The first of these movements might be called the attack 
upon the credit concept. People in both higher and secondary 
education began to doubt the intellectual validity of the unit. 
President Lowell, for example, expressed his scorn for the 
credit concept in these words: 


The credit for a course is treated like a deposit in a savings bank, 
without a suspicion that the deposit is not of gold that can be drawn 
upon at its face value, but of a perishable article. To change the 
metaphor, we treat it like wheat poured into a grain elevator, whereas 
it is often more like fruit in a cold storage plant without the means 
of refrigeration. Indeed, it is sometimes more like the contents of 
an incinerator.’ 


Many another educator adopted this same point of view and 
recognized that units are merely bookkeeping entries which 
record time served rather than intellectual ability or subject- 
matter mastery. This critical point of view took a huge 
stride forward ten years ago when C. S. Boucher, then dean of 
the College at the University of Chicago, succeeded in substi- 
tuting records of performance for records of time served. 
Meanwhile a dozen leading colleges adopted comprehensive 
examinations and thus undermined the bookkeeping system 


1A. Lawrence Lowell, At War with Academic Traditions in America 
(Cambridge, Mass., Harvard University Press, 1934), p. 142. 
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both in colleges and schools. Beaten upon by these powerful 
waves of opinion, the ideological foundations of the unit 
system began to rot, and the rotting has gone on steadily now 
for at least twenty years. 

The second movement came almost entirely from the second- 
ary schools. The unit system had put the secondary schools 
in a strait jacket, and after much uncomfortable and maddened 
wriggling, the leaders of secondary education began to protest. 
In 1929 the Department of Superintendence of the National 
Education Association devoted its Seventh Yearbook to the 
problem of articulating secondary and higher education. Its 
authors directed much of their fire upon the unit system. I 
quote several brief passages therefrom: 


The ancient dominance of the college over the content of the high 
school curriculum is breaking down. . . . There has been a steady trend 
toward liberalization of entrance requirements. The movement has 
proceeded farther and faster in the West and in the Middle West 
than in the East. But even in the East, substantial reduction of 
academic prescription has taken place. Signs are not wanting that 
the secondary school is on the eve of winning its long fight for com- 
plete curriculum independence. (pp. 290-91) 

The high schools are better able than formerly to pursue their 
true task and responsibility of meeting a variety of objectives in the 
education of adolescent boys and girls. Preparation for college is 
only one of these objectives. (p. 314) 

Today the college is more willing than formerly to meet situations 
created by high school determination and obligation to accomplish its 
own independent purposes. The tendency is to seek common con- 
sideration of the problems of college and high school relationship with 
full recognition that adjustment to high school conditions must in large 
part be made by the college. (p. 315) 


This second movement led directly into the third: the at- 
tack upon the unit system by the Progressive Education Asso- 
ciation and the establishment by the Progressive Education As- 
sociation, supported by the General Education Board, of the 
Commission of the Relation of School and College. Before 
this audience I need not describe the work of the commission 
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except to refer to the Eight-Year Study and to the success of 
the commission in persuading several dozen leading colleges 
that they should, on an experimental basis, accept students 
from the thirty schools included in the study, even though they 
do not submit the orthodox pattern of preparation and the 
usual secondary school units. The final report of this most 
significant experiment is not due for two or three years, but 
meanwhile college admissions officers and college faculties are 
being educated to the idea that units are not sacrosanct. They 
have seen hundreds of students doing successful work even in 
conservative curriculums despite the fact that they have not 
had the kind of training that college faculties, in their wisdom, 
have pronounced that they should have. Regardless of the 
contents of the report when it is published, the happy results 
of the work of the commission are already to be observed in 
almost every outstanding college and uni¥esity in the country. 

Important as have been these three movements, the fourth 
seems to me to be the most significant of them all. I refer to 
the effort to demonstrate by statistical/research that the unit 
system is defective. Dozens of investigations have been pub- 
lished bearing upon this problem. I refer to but two of a 
score of varieties: first, the studies that have sought to dis- 
cover the predictive value of the subjects taken in secondary 
school in comparison with the predictive value of secondary 
school grades, intelligence test scores, aptitude test scores, and 
so forth; and second, the thoroughgoing investigations made 
by the Carnegie Foundation in the state of Pennsylvania. 
Since I have recently been amazed to discover that a large 
number of people in higher education are not familiar with 
the results of these investigations, I review briefly those that 
bear upon the admissions situation. 

The first series of studies have produced the result that 
ability and not the amount of secondary school training in a 
subject is the decisive factor in college success. In brief, an 
able student who has had but two years of a foreign language, 
shall we say, is a better college risk than a mediocre student 
who has had three, four, or even five years of the language. 
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These studies have also demonstrated that the best prognosti- 
cation of college performance comes from combining a stu- 
dent’s secondary school grades with his score on an intelligence 
test. In other words, if a student is bright and has worked 
conscientiously in secondary school, it makes little difference 
what college preparatory studies he has taken. These results, 
of course, have cut into the underpinnings of the unit system. 

Even more devastating have been the findings of the Car- 
negie Foundation studies in Pennsylvania. Indeed, I would 
go so far as to credit the Learned-Wood volume, The Student 
and His Knowledge, published early last year, as one of the 
most important publications ever to appear in American edu- 
cation. In that volume are torn away a half a dozen of the 
false faces behind which American education has been postur- 
ing. One of the most important of these is the unit system. 
I quote but one brief passage: 


Are fifteen units of admission to be required? Must the student be 
from the upper third, fourth, or fifth of his class? . . . It is an im- 
possible game with artifical counters. The student who is both chief 
player and the sole stake in the process is ignored by the rules. He 
wins or loses by an imaginary score. (pp. 68-69) 


These four movements have already begun to show results, 
results so substantial that a number of institutions have already 
abandoned the unit system entirely, and a number of others 
pay it but lip service. In the former group are Dartmouth, 
Colgate, and Sarah Lawrence; in the latter, among others, 
Harvard, Amherst, and Stanford. The Dartmouth admis- 
sions plan—to cite but one from the first group—was adopted 
five years ago and is described in the current Dartmouth 
catalog as follows: 


Beginning with the Class of 1938 the inflexible fifteen-unit require- 
ment was waived and the requirements for admission to the College 
are now as follows: All candidates who are admitted to Dartmouth 
College shall have satisfied the requirements of the Selective Process 
for admission and shall have presented evidence satisfactory to the 


2 Ruth Strang, Personal Development and Guidance in College and Second- 
ary Schools (New York: Harper & Brothers, 1934), pp. 131-32. 
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Committee on Admission that they are competent to carry on their 
course of study at Dartmouth College. 

This change was made after twelve years of experience with the 
Selective Process had demonstrated that no specific set of formal en- 
trance units as presented by a candidate was sufficient to assure suc- 
cessful accomplishments in college and that any one of many school 
programs was capable of developing habits of study and providing 
background and preparation necessary for undertaking the course of 
study offered at Dartmouth College. 


The Colgate and Sarah Lawrence plans are similar. These 
three institutions have had the courage to throw the unit plan 
overboard. They have become convinced that counting units 
does not select the kind of students they seek, and they have 
followed the logic of the conviction and have abandoned the 
unit system.® 

Meanwhile Harvard, Amherst, Stanford, and a score of 
other institutions keep the unit system in their catalog de- 
scriptions of admissions but circumvent it by various devices. 
At Harvard the device is Plan B under which “no fixed num- 
ber of units of school work is prescribed; great weight is 
placed upon the candidate’s school record and upon the prin- 
cipal’s recommendation. . . .”” Since the great majority of 
Harvard freshmen enter through Plan B, Harvard has essen- 
tially abandoned the unit system. 

At Amherst only six specific units are required: * three units 
of English and three of mathematics. Since practically every 
secondary school student takes English and mathematics and 
presents them for college admission, the requirement is all but 
meaningless. It is comparable to requiring that every candi- 
date for admission come with a pair of shoes instead of bare- 


* Colgate requires fifteen units but does not specify them. Similarly Sarah 
Lawrence requires sixteen. Since requirements are in vogue merely to indicate 
the completion of secondary education, the absence of specificity is the significant 
fact, and justifies the conclusion that the substance of the unit system has been 
abandoned. 

4 Amherst requires fifteen units for admission, only six of which are specified. 
Preference, however, is given to candidates offering five units in foreign 
languages, ancient preferred. 



















The Current College Admissions Situation 41 


footed. The same is true for the Stanford requirement that 
each applicant present two years of senior high school English. 
Everyone who would think of applying for admission to Stan- 
ford would, of course, have had two years of senior high 
school English. I can think of only one explanation for the 
requirement: the Stanford faculty is as yet unwilling to go the 
whole hog in abandoning the unit system. The same explana- 
tion, it seems to me, accounts for the situation at Amherst. 

I might cite a number of other institutions which have in 
whole or in part dropped the unit system. These six illus- 
trations are, perhaps however, sufficient to demonstrate that 
the system is losing ground rapidly. Meanwhile the General 
Education Board by its support of the Eight-Year Study and 
the Carnegie Foundation by its sponsorship of the Learned- 
Wood studies have thrown the weight of their influence behind 
the attack. Under such a barrage as this the end of the unit 
plan must soon be near. 


New RESPONSIBILITIES OF THE COLLEGES 


Meanwhile a number of new responsibilities challenge the 
intelligence and ingenuity of college administrators and facul- 
ties. Here I discuss but two of these responsibilities: first, 
the need of differential curricula, and second, the need of 
improving and applying techniques for the appraisal of stu- 
dent abilities, aptitudes, and ambitions. 

The first of these responsibilities has come in for consider- 
able discussion in recent years. The General College of the 
University of Minnesota stands not only as a milestone of 
progress but also as a symbol of the kind of development 
that we must promote in American higher education. Many 
of the old and well-established institutions of the country, 
particularly those in the East, will be able to continue to select 
for admission only the so-called aristocracy of brains; but the 
great majority of the colleges and universities of the nation 
must accept the hordes of students who clamor for admission 
even though they do not have the intellectual capacities or the 
interest—or both—to undertake the abstract studies of the 
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liberal arts college. Instruction beyond the high school cannot 
be denied these applicants, and it is the responsibility of higher 
education to see that they are given the kind of education that 
they are able to master and to use. 

The rise of differential curricula constitutes one of the most 
interesting chapters in the history of American higher educa- 
tion. The liberal arts college of a century ago fought the 
invasion of utilitarian instruction in engineering, agriculture, 
and commerce; and thus, of necessity, a score of vocational 
and professional colleges came into existence. For decades 
they have been making important contributions to the develop- 
ment of higher education and to the improvement of American 
society. The differentiation of instruction which these utili- 
tarian colleges provide is not, however, sufficient to meet the 
needs of the tens of thousands of applicants who want work 
beyond the high school. A growing proportion of these 
applicants do not have the capacities to profit either from 
liberal arts instruction or from instruction in the vocational 
colleges. Either they must be denied admission or provision 
must be made for them. 

This problem has been with us for many years, but the 
imminent passing of the unit system brings it into bolder relief. 
If the secondary schools are no longer to be dominated by 
college admission requirements, even larger numbers of stu- 
dents will be knocking at the gates of the colleges with insufh- 
cient preparation and insufficient ability to handle any of the 
existing curricula. Since the state universities in particular 
cannot, in general, deny admission, they can follow one of two 
courses of action. In the first place, they can admit such stu- 
dents and then promptly dismiss them because of their intel- 
lectual limitations; or in the second place, they can establish 
special curricula designed to meet their needs. We are talking 
endlessly these days about democratic education, but we shall 
not achieve democratic education until educational opportu- 
nities, commensurate with their talents, are made available to 
these thousands of students who do not fit into our existing 
curricula. During the past century differential education has 
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become an established principle of American higher education, 
but we still have a long way to go. 

Within the framework of our present curricular patterns 
we also face the problem of differentiation. The fixed cur- 
riculum of a century ago is all but dead (although the concept 
is being revived at St. John’s College in Maryland), and yet 
despite this very desirable change in educational thought and 
practice, most institutions leave the educational destinies of 
their students to chance or to the inadequate direction of 
poorly trained and generally incompetent counselors and ad- 
visers. The principle of differentiation is sound, but it has 
dangerous implications unless it is supported by careful ap- 
praisals of the abilities, aptitudes, and ambitions of students. 

The topic of educational appraisal or diagnosis is so large 
that I can merely touch upon it. I therefore confine myself 
to a single generalization. It is this: If the secondary schools 
are to send students on to college without unit credentials, 
then colleges must put every matriculant through a careful 
appraisal of his educational status and of his personal char- 
acteristics. Only with such data available is it possible to 
counsel students adequately concerning their course programs 
and the steps they should take toward their personal- 
nonacademic development. 

After thirty years of intensive research we now have a 
number of excellent instruments of measurement to employ in 
counseling. We also have begun in recent years to train a 
group of personnel officers who are equipped to use and in- 
terpret the results produced by these instruments. Alas, 
however, many institutions do not use such instruments at all 
or they are handled by people who have had little if any 
training in their application. Thus, although the techniques 
of counseling have been brought to a high degree of effective- 
ness, they are largely being neglected or inefficiently or dan- 
gerously employed. The result is that the best interests of 
students are being overlooked or damaged, and many of the 
productive opportunities of differential instruction are being 
wasted. 











44 The Educational Record Supplement for January 1940 





Some happy signs, however, appear upon the horizon. A 
better type of student personnel literature is beginning to 
appear, literature intended for the education of administrators 
and faculty members—books such as Williamson’s How 
to Counsel Students and the two “Studies” of the American 
Council on Education on the Educational Counseling of Col- 
lege Students and Occupational Orientation. Moreover, a 
growing number of administrators are becoming aware of the 
large potentialities of personnel work when directed by well- 
trained people. Great progress has been made during the 
past ten years, and the time may soon be here when it is part 
of the program of every college and university to give every 
student it admits a thorough appraisal under the direction of 
people competent to make such appraisals. Until that time 
comes the abandonment of the unit system will not be an 
unmixed blessing. Units must be replaced by a careful system 
of appraisal leading to an informed rather than a haphazard 
type of differential instruction. 


THE CHALLENGE TO THE SECONDARY SCHOOLS 


While the colleges and universities are at work improving 
their practices, the secondary schools face perhaps an even 
greater challenge. The death of the unit system gives the 
schools what they have long been crying for: an opportunity 
to give each student the sort of education that he most needs. 
This, of course, involves appraisal and differential instruction 
in the secondary school; but, of even more consequence, it 
involves freedom from prescription so that the schools may 
develop their own programs. The development of such pro- 
grams, in turn, requires the determination of objectives which 
are more carefully thought out than most of the objectives 
now established. 

This is, of course, a large topic; and I therefore discuss 
but a corner of it. As the president of a college of liberal arts 
I am enthusiastic about the abandonment of the unit system, 
but we in higher education will be vigorous in our criticism of 
the schools unless they send us students who are better 
equipped to continue their general education than are most 
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of the students who come to us now. The unit system has 
been defective, and the freedom from its restriction must give 
us something better. Personally I ask but three things of the 
secondary schools: first, that their graduates know the funda- 
mentals of the English language and that they have had sub- 
stantial training in writing and speaking it; second, that they 
know how to read English with reasonable speed and compre- 
hension; and third, that they have learned how to concentrate, 
how to study, and how to apply themselves to their work. 
Given average intelligence and these abilities, we in the liberal 
arts colleges can proceed to carry forward the general educa- 
tion of our students. Without them we merely go through 
the motions and waste our time, the time of the students, and 
the resources of society. 

To ask that the graduates of secondary schools who come 
on to liberal arts colleges should know how to speak and write 
their own language, how to read it, and how to apply them- 
selves is little indeed. Scandalously large proportions of lib- 
eral arts college freshmen, however, are defective in all three 
of these fundamentals. The result is that the colleges must 
devote the freshman year to an educational job that should 
have been performed by the secondary schools. ‘The situa- 
tion cries to heaven for improvement, and with the wane of 
the unit system the schools now have their opportunity. 

The complaint until now has been that college entrance 
requirements forced the schools into tight compartments of 
work and that therefore the needs of the student and these 
basic skills had to be sacrificed. This complaint is coming to 
be less and less applicable, and soon it will have no substance 
in fact. Beginning immediately the schools must start to 
demonstrate that they are able to handle the situation for 
which they have long clamored. American education will be 
in a mess if they fail to produce. 


CONCLUSION 


The unit system, as I think I have demonstrated, is on its 
last legs. It came into existence to meet an insistent situation; 
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it goes out because the situation has changed and because we 
need something better. It has been postulated that the secon- 
dary schools need freedom to carry on their programs and 
relief from the heavy hands of college admissions officers. 
The postulate seems to be sound, but whether or not it proves 
to be as sound as we think will depend upon how the colleges 
and the secondary schools meet the challenging opportunities 
which face them. Only if the schools will send on to college 
graduates with at least the simple skills needed for advanced 
education, and only if the colleges in turn will establish pro- 
grams of student appraisal leading to sound differential in- 
struction, shall we be equal to the problems which we now face. 

The college admissions situation is today in flux. It need 
not continue to be if both secondary school and college edu- 
cators take advantage of the great opportunity which stands 
before us all as we listen to the death rattle of the unit system. 





Some Values of Progressive Education 
for Women 
By MARION E. PARK 


EAN HAWKES asked me last year to speak at this 
LD conference and suggested that my subject should be up 
my own alley, and something about girls. This went 
along with my inclination and the up-shot of our agreement is 
the portentous title of this noon. Rather less formally than 
it threatens, however, I should like to point to connections 
between the education of girls and women and the so-called 
progressive ways of teaching and learning. Now I am clearly 
much less well qualified on the second half of the subject, for 
I myself both learned and taught without the light; my facts 
have been picked up from desultory reading and the conversa- 
tion of the elect, my impressions from observation of young 
women who have been taught in schools that can be called, in 
varying degrees, new line. Consequently, as I cannot have the 
advantage of an immediate give-and-take conversation with 
you, I have questioned how to present the present state of 
my opinion and I have concluded that I can most usefully be 
specific on the half familiar to me, and ask you who are 
familiar with the theory and practice of progressive educa- 
tion as you listen yourselves to make specific what I shall 
imply, for in spots at least my implications are explicit and 
the experience which the girl needs in her process of formal 
education will seem neatly met by the experience which the 
progressive school offers. In other spots I think it is not so 
clear. 
I should like to speak of women’s education from two 
angles. 
First: It is a fair statement that since time began there has 
been far less thought spent specifically on the education of 
girls than specifically on the education of boys. One can im- 
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mediately observe that in great part girls’ education has not 
suffered thereby because many, indeed most, of the needs of 
the two are common, and the road travelled by one must be 
travelled by the other also. Women’s education is historically 
a recent process of civilization. Only about one hundred years 
ago a new group began to filter into an established process, 
the school and college worked out for men only. Schools for 
girls had more varied forms of birth, but the women’s colleges 
slipped into the educational system usually in one of two ways. 
Some without any feminist point of view but as a matter of 
course set up for young women the curriculum and method 
which colleges for men had tried and found satisfactory. On 
the other hand, some took over every dull detail with clenched 
teeth and dramatic purpose to prove at once and in perpe- 
tuity that women can match men intellectually. This was by 
no means a false start—women can in fact thank Heaven 
for it. The most desperate modern innovator cannot think 
of women’s education in wholly new terms and begin to offer 
wholly new wares from her counters. For this has an implica- 
tion which cuts to the bone. It would be to agree to inborn, 
essential differences between men and women only to be met 
by different educations built on different foundations. There 
has undoubtedly been a great cloud of witnesses on the other 
side—legal and religious systems, traditions, anthropologists, 
laymen, teachers, parents who have asserted such inborn, 
essential differences and acted consistently on them. We can- 
not forget as we sit here that the essential difference between 
the sexes is a widely used, powerful contemporary principle. 
On it the present national-socialist and fascist governments 
in Europe base their policies in the use of the man and the 
woman citizen. But many of us know that the soundest an- 
thropologists uphold the opposite hypothesis; they argue that 
the so-called sex differences of conduct are the result of social 
suggestion and standardization which, though it varies with 
varying patterns of culture, occurs almost universally. 

No one who has read Margaret Mead’s last book could 
resist quoting something of it. She finds, for instance, that 
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one New Guinea tribe, insulated from the rest of the world, 
indoctrinates men and women equally to cooperation, gentle- 
ness, responsiveness to the needs of others, especially children; 
another, equally independent of contacts, trains both sexes to 
aggression, violence, ruthlessness—the women as regardless of 
the children as the men. Still a third presses its younger gen- 
erations into two different molds as we do, but makes the boys 
gentle and emotionally dependent and the women aggressive 
and dominating. Dr. Mead and her readers naturally con- 
clude that these different aspects of behavior cannot actually 
be tied up with sex at all. And she proceeds to carry the 
argument into European-American sex traditions and stand- 
ards. Sidney Smith, who was there in 1815 before her, said: 
‘‘As long as boys and girls run about in the dirt, and trundle 
hoops together, they are both precisely alike. If you catch up 
one-half of these creatures, and train them to a particular set 
of actions and opinions, and the other half to a perfectly 
opposite set, of course their understandings will differ, as one 
or the other sort of occupations has called this or that talent 
into action.” 

If Margaret Mead and Sidney Smith and the rest are right, 
American men and women of 1939 differ because our society 
has agreed to indoctrinate each with the idea that men take 
by nature certain attitudes and women certain attitudes; that 
the man’s attitudes are, say, enterprise, initiative, fearlessness, 
and the woman’s, regard for personal relations, emotional 
responsiveness, care for human life. 

To anyone interested in education who ponders long on the 
results of this indoctrination two things seem reasonably clear 
which without pondering we only half recognize: first, that 
even in their milder forms, not in Germany but in New York, 
they must cramp the individual boy or girl at every point 
where he or she varies from the arbitrary man-or-woman- 
pattern; and second, that the whole texture of our society 
might be richer if we did not train young persons to think 
and act in two great formalized groups, men and women, but 
made them instead merely human individuals able to develop 
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in any possible directions for which they have the purposes 
and abilities. 

For women, to speak lightly, the hypothesis that the appar- 
ent differences in mind and character between men and women 
are not fundamental or final is refreshing, for society except 
in an occasional New Guinea tribe has often doomed us to 
the more limited and duller of the two patterns; and, to speak 
seriously, the final rejection of the hypothesis could be agreed 
to by us only after longer and more honest experimentation 
with it. And it is important to remember that this was the 
hypothesis which brought women’s education into existence. 
Their schools and colleges did not come into being to educate 
more people; they were a plea for educating everyone who 
was worth it. If education for women in America is free to 
keep on using a curriculum which by and large serves the pur- 
poses of both men and women—at least until the scientists 
tell us more about ourselves then we know now—not only 
women but society in general may profit. But if you give us 
this leeway we are bound to work over the hypothesis seri- 
ously, putting blood and sweat and money into the experiment. 
We may run down proof for or against it in such devices as 
these: help given to every girl or woman to follow her unique 
pattern and examination of the result, especially to the girl 
who wants to leave the conventional pattern, attack a new 
job, try a new field; a sharply emphasized break in our own 
standardized male and female pattern—the presence, for 
instance, in schools and colleges of a teaching staff of both 
sexes so that boys and girls shall see for themselves that the 
teacher’s, the scholar’s life in this classroom differs from 
the teacher’s and scholar’s life in that as the individual, 
not the sex differs; the encouragement of unself-conscious 
work-a-day relations between young men and women com- 
parable to unself-conscious work-a-day relations between 
members of the same sex. And wherever such indoctrination 
comes to the surface in the girls and women we teach—if they 
are docile, for example, or lack objectivity in opinion, or 
cooperate poorly, or are intellectually timid—the girls’ school 
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or women’s college must by hard work and primarily by its 
own example emphasize initiative, give-and-take relations be- 
tween individuals, in families and communities, seriousness, 
and the courage on which truth and liberty must rest. 

Now my second point: If women’s education continues an 
experimental period and uses for girls a curriculum common 
for boys on the ground that we are in common human beings, 
must we go the whole hog? Do the academic problems of 
the women’s schools and colleges differ in no way from those 
which the schools and colleges of boys also face? Do we need 
any special material or method? Do any details need our 
special attention? I have been thinking this over for a large 
number of years in connection with the college which I know 
best, and I have come to the belief that the answer is yes. 

Let me narrow the question a little. For some women 
students the choice of college curriculum and experience is 
arbitrarily made. Men and women alike who wish to prepare 
for the professional school and a later professional career 
must take from the general bill-of-fare the preliminary train- 
ing which is necessary and identical for both. I may say in 
passing that among girls this group is, still, smaller and less 
varied than among men students. And probably for a second 
group of women, if I can argue from the college I know best, 
the question is not worth long discussion. That group uses the 
college set-up and curriculum for no very clear purpose and 
gets the A.B. degree without reasoning why! And I should 
hazard a guess in passing that in the women’s colleges this 
group is again, and here fortunately, smaller than in the col- 
leges for men. But a third group of young women—and it is 
by far the largest—has used the curriculum in the past and 
now uses it to build up a richer kind of life for themselves 
and to make their decent contribution to the good society, 
to America, to the kingdom of Heaven on earth—whatever 
you choose to call it. In the women’s colleges this group is 
very large. Its problems are peculiarly in need of foresight 
and forethought, for they are very difficult and their solution 
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is very important to society. For the moment let this large 
group include all. 

These young women are much more like men than unlike 
them; they come to college for personal and social ends which 
are also men’s; on the whole, the pattern of their college 
experience should be the same; yet their lives will have a 
somewhat different turn—this turn we cannot ignore. The 
professional woman, for example, will meet not only the nor- 
mal discouragement and difficulty of her profession of medi- 
cine, law, architecture or teaching, but additional problems 
because her place in those professions is more lightly regarded 
by the community than the man’s. She must work harder for 
success and the fields of success for her are narrowed. This 
has been thrown in relief in the last years and needs no 
elaboration. 

This is still more true of the unprofessional majority of 
women students. Though they are not to be doctors or pro- 
fessors, they will often begin by holding paying positions, jobs 
of real importance and interest. They will be intelligent, 
competent, useful to their communities. And with them mar- 
riage will occur in a high majority of cases. This enriching of 
their experience and interest will make them more intelligent, 
more competent, more useful to their communities, but it will 
interfere with a unified individual life far more than in the case 
of their husbands. The college has at least two responsibilities 
if it looks to the typical pattern of their lives. It must fore- 
see along with them the special problems of the mother of 
children, and it must also foresee with them the general prob- 
lem of the broken-in-on life, the life in which the important 
interests and responsibilities are not unified but are entirely 
different at different times. 

The mother’s special problems don’t need my amplification. 
While she is bearing children and during the early years of 
their rearing she is meeting something totally unlike anything 
that could be handed out by her personal experience. She is 
likely to have physical discomfort and disability, sharp crises 
in childbirth, confinement with immature human beings 
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“lumps of flesh” as Dr. Johnson tenderly calls them, a good 
deal of monotonous physical care, sudden demands for com- 
plicated physical and psychological information, and a twenty- 
four-hour-day responsibility month after month. The women’s 
college should, I believe, make as full, as authoritative, and 
as interesting as possible for the majority of its students, who 
certainly have this ahead of them, the content of certain com- 
mon courses whose material will form a good basis for their 
needs. These courses include of course the biological sciences, 
psychology, and philosophy. These courses should be rich 
in content, various, and up-to-date. A great deal of money 
should be spent on them in all women’s colleges. But the 
young woman’s own knowledge will not see her through. She 
cannot afford not to know what is the difference between expert 
and elementary, or up-to-date and behind-the-date knowledge 
because in the queer, unforeseen, important problems she will 
face she must know with accuracy when her knowledge of facts 
is failing her and when she must call in the expert for help. 
Independent and advanced work of her own gives her this 
picture as nothing else does. And for this reason and for 
another which I shall mention, advanced work should figure 
largely in every girl’s education. On the practical techniques 
of care, diet, nursing, and the rest I think we need spend no 
time or money. They are laid down by technical authorities, 
they change too fast to be committed to memory, and they 
can be acquired by an intelligent and sensible woman, even an 
aunt, with relative speed. 

And, second, there is the general problem, occurring among 
men but far more common among women, of preparation for 
a life in which the balance of interests and responsibilities 
swings to and fro. For a woman, her student days, a time of 
relatively independent experience, will probably be followed 
by a time of absorbing attention to a family. This will later 
and rather suddenly be replaced by a renewal of free time and 
free interest, but the actual techniques, the profession, the 
training learned earlier will be rusty or out of date, and in 
many cases she will find it perplexing to resume the more inde- 
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pendent direction of her life again. The education of girls 
should look ahead to this situation, I believe, and provide and 
encourage them in some strong interest and, if possible, occu- 
pation to which they may be able to return because its basis 
is so fully and soundly built up in their minds that it can sur- 
vive a long break in surface attention. The problem of giving 
a permanent, intellectual interest, remaining vivid among the 
complicated demands and exigencies which women must meet, 
is one of the most difficult ones which women’s education must 
solve. We are making slow steps toward it. It is an argu- 
ment for honors courses in a college for women, for a major 
system by whatever name it is called with a full and rich con- 
tent laid down by law. It is an argument again for presenting 
any and every kind of material to girls by methods which they 
can master and apply to their own intellectual interests later 
on when they find themselves unable to turn quickly to old 
sources. In education for girls it makes the budgeting of 
time specially important, the acquiring of what I may call 
intellectual exercise—the use of books, the use of discussion 
and certainly careful technique in thinking, reasoning, weigh- 
ing of judgment—anything which will anchor a woman to an 
old intellectual interest or teach her how to take on new 
interests developing from it or replacing it. 

And our academic duty is not all. The residence and the 
environment of the family will be more often selected with a 
view to the husband’s interests and advantages than the wife’s, 
and yet in many cases she will have the greater responsibility 
for the family relations in the community. To meet this I 
believe that schools and colleges should give girls and women 
as much responsibility as possible without protection from 
their failure or mistakes, and this not only in the academic 
part of their experience, but in their social life. We can 
take advantage of the smaller stage which the compact com- 
munity affords and the quick comeback of a group of out- 
spoken contemporaries to give them a kind of rehearsal for 
their lives in their own communities. But this rehearsal is 
also in itself entirely real; it needs the utmost personal free- 
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dom which can be given; it can be supervised profitably only 
at the start. Girls need themselves to understand and dis- 
cuss and criticize pro and con academic and administrative 
policies as they affect the individual. They need full swing 
not only in the practice but in the management of every kind 
of activity into which they can enter and which I don’t need to 
enumerate—acting, debating, publishing, work in the com- 
munity. Certain practical needs can conveniently be attended 
to if their families have failed to provide them. For by the 
way and on the side sometimes, we must try to give them some 
way to begin to earn their living. Long holidays can be used 
for this, for some acquaintance with typewriting, account- 
keeping, with the various athletic and domestic and artistic 
skills which will be useful to them and in their communities. 
And (this on the side) the schools and colleges for girls 
should themselves try to develop by their own example, by 
propaganda among their alumnae and their clientele the part- 
time job for salary or wages, and the responsible and interest- 
ing volunteer job, so that their earlier students returning to 
an outside interest or duty after absence from it shall find 
the first steps, and indeed the final outcome, not impossibly 
difficult. 

I have deliberately not spoken of the special education the 
girl needs—so I have come to feel more and more—for citi- 
zenship in America and the world. Rather she needs it no 
more than the man, but unless she can be developed into a new 
factor in so-called civilization, a new force, a new power to 
be reckoned with by the forces of reaction and disintegration 
—the plight of humanity is indeed grave. A man-trained 
world is at a dismaying pass. How can we make the woman 
student hate war, prize liberty, love justice, and work and 
vote to carry out her beliefs as man-made education has 
failed to make her do it? How can we add or subtract from 
our curricula and methods and bring our women out with a 
new mind toward the world they inherit? Can this new mind 
possibly be the woman’s contribution to the common education 
of men and women, to be borrowed and set to work not only 
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in all our colleges but in all those where men are educated? 

I hope that the impressions, which I have gathered from 
my office and campus, of the connections between women’s 
education and the philosophy underlying the progressive 
movement have seemed real to you as you have listened and 
been contributing your special knowledge to mine. Let me 
add (like Polonius’ wise saws) a few more definite sentences. 
Women should not be taught by methods which make for 
dependence like the unbroken lecture system or which scatter 
interest like short, unconnected courses. A liking for experi- 
ment but also the ability to estimate an experiment, ability 
to increase steadily the span of working without outside 
check-up or even inside results will be pre-eminently useful to 
women. Any discipline which carries their experience forward 
into the area of incessant complications and discouragements, 
but which shows them the rewards of knowledge, anything 
which forces work at an increasingly advanced level will some- 
time be solid rock under their feet. In their college life they 
should learn to work with a group and to subordinate a per- 
sonal point of view, for I believe democracy needs the group 
as well as the individual on whose good will and intelligence 
it eventually rests; to use freedom and get rid of confining 
traditions and restrictions, always to retain common sense 
and respect for other individuals. 

In many of these demands which women students make on 
all who take part in training them, the progressive philosophy 
of education seems to me to be an immediate and powerful 
assistance. I leave its closer application to an audience far 
more familiar with it than I. 





Major Problems in Occupational 
Adjustment 
By EDWIN A. LEE 


HE topic assigned to me is new to this conference, but 

it is not new to any of you who are in education—in the 

secondary schools, the liberal arts college, or the pro- 
fessional and graduate schools. Every individual who comes 
under our tutelage faces almost inevitably the problem of 
occupational adjustment. For a limited number who might 
be called idlers or wastrels, the problem apparently does not 
exist, but they are so few that for all real purposes they do 
not need to be taken into consideration in any discussion of 
our problem. Youth, as he approaches maturity, must make 
occupational decisions, must have occupational experiences, 
and eventually must participate in some form of occupational 
activity. 

There are many terms that might have been used as the 
keyword in the topic for discussion. For example, we might 
have used the topic “Major Problems in Vocational Educa- 
tion,” and for some of you that would have been comprehen- 
sive enough to include what I propose to discuss. Others 
might have been perfectly content with “Major Problems in 
Guidance,” for there is a considerable group of workers and 
thinkers in this field who would say that was the all-inclusive 
term. Some, indeed, might have been satisfied had I been 
talking on this program in terms of “‘Major Problems in the 
Industrial Arts Field,’’ for to many secondary principals and 
secondary teachers, industrial arts, vocational education, guid- 
ance or occupational adjustment are interchangeable terms. 

None of these, however, seems to me to be comprehensive 
enough to convey to you what I wish to discuss as major prob- 
lems. Therefore, I have written a simple definition which 
reads as follows: 


57 














58 The Educational Record Supplement for January 1940 


Occupational adjustment for purposes of this discussion 
connotes a program, generally under public school auspices, 
the purpose of which is to bring about for each individual a 
reasonable relationship between the work that individual de- 
sires to do, the work he is qualified to do, and the work which 
needs to be done. 

With that brief introduction to the discussion, let me pro- 
ceed to eight major problems for your consideration. The 
first problem I shall state rather categorically. It is to bring 
together the separate and often distinct elements of the prob- 
lem into one coordinated, long-time program, a program 
which accepts responsibility for following the individual from 
the time he first begins to think about occupational matters, 
wherever that may be, until he is satisfactorily launched in a 
work which is wisely chosen and for which at least the begin- 
nings of adequate preparation have been made. 

What is the scope of this field of occupational adjustment ? 
What are these various elements that I am saying in their 
separateness require to be brought together? First, there is 
the element of selection. Every individual is faced with this 
problem of selection of work which he shall do. For some, 
it may truly be the selection of a life work, but I am con- 
sciously stating it as work which each may do, hoping that in 
the majority of cases, it may be the life work, but recognizing 
clearly that for many there is a trial period in not one but 
a number of occupations before what may be truly called the 
life work becomes the occupational activity of each individual. 

That selective process has generally been known in our 
public schools by the term “‘vocational guidance.” It involves, 
on the one hand, the dissemination in simple but intelligible 
form of all that should be known about occupational life in 
order that one may choose therefrom with some wisdom and 
some understanding. It includes information which is not 
only local but state-wide and in some cases nation-wide. It 
involves in the second place, so far as it is possible so to 
organize it, a period of exploration, an actual trying out, at 
first hand, either in actuality or in simulated situations, of a 
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wide variety of occupational experiences in order that one 
may get the “feel” of an occupation. In the third place, it 
involves a careful, scientific self-study on the part of each indi- 
vidual, because the selection of the work which one shall do 
requires an integration of knowledge concerning the kinds of 
work to be done and the qualities which one possesses to do 
work. 

This element of self-study is in some ways the most im- 
portant of all, because it is on the basis of one’s limitations, 
one’s potentialities, one’s idiosyncracies, one’s desires, that 
many of the choices ultimately must be made. It is within this 
realm that the Educational Records Bureau has made some 
of the most significant contributions to our knowledge and 
practice. 

For many communities, it has been assumed that occupa- 
tional adjustment has been accomplished when this first ele- 
ment of selection has been satisfied, but in reality it has not 
been accomplished at all. After the selection of a work which 
one desires to do, there follows naturally the period of prep- 
aration, a period which in some cases may be short, even to 
a shortness which can be named in terms of months, or a 
period which may be long, as indeed is the period of prepara- 
tion for such a field as medicine under modern conditions. 

Whatever the length of the period, selection must be fol- 
lowed by preparation. Most of you know it in terms of voca- 
tional classes, vocational schools, trade schools, agricultural 
education, classes in home-making, or business education. 
There are several terms which can be used aptly here to denote 
certain phases of this element. The acid test of this element 
is whether or not an individual, by reason of the experience 
or the training and the knowledge which is gained through 
the period of preparation, has thereby become equipped to 
take his place at a wage-earning level in the occupation chosen. 

There are some communities which assume that if they 
have set up what they conceive to be a satisfactory program 
of vocational education, they have met the entire set of re- 
quirements involved in occupational adjustment. But, again, 
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it must be pointed out that the program is incomplete unless 
there follows, in the third place, what, in terms of its implica- 
tions, is probably the most subtle single element of the four 
included in the scope of occupational adjustment. 

For this discussion, I have called this third element induc- 
tion, rather than the more commonly used term of placement. 
Placement has a connotation of something completed, whereas 
induction has the connotation of something continuing. It is 
the second idea that I should like to emphasize, for it is not 
enough in a program of occupational adjustment that you 
shall have helped a youth to select wisely and shall have 
trained him to a point where he is capable of accepting wages 
at a given level. There is the further necessity that he shall 
be inducted into the actual work which he proposes to follow. 

Here come some of the most pointed problems of youth. 
I need only ask you to recall in your own early manhood or 
womanhood the perplexities and the dilemmas and in some 
cases the heartbreaks which were involved in trying to find 
your first job, and, when you had found it, in trying to get 
started in it. Such are the conditions under which modern 
youth must go to work that, in envisioning the scope of occu- 
pational adjustment, we have been forced to give a very 
important place to the problem of induction. 

The fourth element naturally grows out of induction. It 
is concerned with promotion and self-improvement. Most 
youth are not content to stand still—they wish to advance 
both in responsibility and earning power. All too few school 
systems have paid any attention at all to this aspect of the 
total problem of occupational adjustment. It represents a 
fertile field for experimentation and service. 

There you have it. The first major problem is to bring 
together these separate and often distinct elements into one 
coordinated, long-range program, which has a beginning and 
an end and a continuity from beginning to end. 

The second problem grows out of the first. It may be 
stated as follows: To bring about an acceptance by administra- 
tive officers in public education, whether on the secondary level 
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or the college level, of their responsibility for understanding 
this problem of occupational adjustment, and then taking the 
lead in developing the program in terms of the peculiar needs 
of the communities they serve. 

Your chairman has suggested that I might speak briefly 
about the occupational tour at some time during my discus- 
sion. This is an appropriate place to say a few words about 
it. It was because the executive committee of the National 
Occupational Conference was convinced that this problem of 
gaining acceptance on the part of administrative officers was 
of such primary importance that they authorized me, as the 
director—and furnished funds so that I might do it—to invite 
a selected group of administrative officers, superintendents of 
schools in this particular case, to join with us in a carefully 
organized tour of cities in which one or more of the elements 
of an occupational adjustment program were exemplified. 

When I tried to find cities in which all three or four were 
in evidence, I found none. I was forced, therefore, to choose 
one city in which occupational guidance was well done, another 
city in which induction seemed to be well done, and a third 
city in which the problem of vocational training per se was 
excellently done. For two weeks this group of superinten- 
dents, released by their boards of education from all responsi- 
bility at home, living intimately within the confines of a 
private Pullman observation car, traveled from city to city, 
spending time in the observation salon as we sped along in 
what we finally came to speak of as a Seminar on Wheels. 
By the interplay of experience and critical judgment, we finally 
arrived at a statement something like the one I have read you 
as to what should be comprehended in a program of occupa- 
tional adjustment. At the end of our travel, we adjourned to 
a secluded, quiet inn in New Jersey, and for two days we tried 
to determine what it was we had seen and discovered. We 
brought forth a simple report, and then each of the men 
went home. 

You might have expected that, when they had gone home, 
the routine of daily work would have caused this experience 
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to recede as the days went by, but apparently something had 
happened to these men, for that was not what occurred at 
all. In each of these communities—and there were twelve of 
them, located at strategic points throughout the country— 
these administrative officers immediately commenced to make 
their influence and their understanding felt with those with 
whom they were associated. In almost every case, immediately 
they selected certain of their staff to go to one or another of 
the communities we had visited and to study in some detail 
what we had seen only in the broad, general strokes. 

I visited each of the twelve cities a year later. Something 
had occurred in each city which the administrator in charge 
said could not have occurred had he not had the experience 
which I have related. Not alone did these superintendents do 
this, but they became so interested that in each of the cities 
there was arranged a conference which brought into each 
community representative administrators from the surround- 
ing districts, and for a period of two or three days this same 
problem was discussed. The report, ‘““A Record of Accomplish- 
ment,”’ indicates that the influence of that first tour within a 
year or so had increased to approximately four hundred ad- 
ministrators who had given careful and sympathetic attention 
to this problem in its completeness for the first time. Problem 
two, then, is to bring about an acceptance of their total 
responsibility on the part of all administrative officers. I am 
convinced that not until those who are responsible for direc- 
tional policy-making in school systems or institutions know 
what this problem involves in its fullest dimensions, are we 
likely to make any measurable progress towards the solution 
which the conditions and the situation demand. 

Problem three is a much more detailed problem, but it is 
one of the most difficult, as every one of you who has tried 
to solve it knows. It is to secure competent personnel. This 
matter of getting competent counselors, for example, in our 
secondary schools, is one of the most perplexing and one of 
the most baffling that you and I face. It takes such a superla- 
tive person to do the job and do it well that it sometimes 
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seems as if we were almost hindered from any significant prog- 
ress because of this one fact. 

You should know in this regard that under the chairmanship 
of Ben Wood, in cooperation with a committee named by the 
National Vocational Guidance Association, there is now being 
formulated an experiment by which we hope to arrive at some 
way of selecting, out of all those who may be chosen, the 
particular individuals who lend themselves by qualifications, 
by experience, by desire, by personality, to significant accom- 
plishments in this field. I think we have reason to believe 
that when this experiment has been carried through under 
Dr. Wood’s direction, we shall have much more accurate 
techniques, facilities, and tools, for the securing of competent 
personnel in the ranks of counselors. 

But the problem is almost as complicated when you deal 
with the second group, those definitely responsible for the 
training in the occupation chosen. We face right off the 
inescapable fact that he who is to teach an occupation must, 
first of all, be skilled in that occupation to a high degree. 
The teacher of surgery must be the best surgeon that we can 
persuade to accept the responsibility of teaching, and, likewise, 
the teacher of automobile mechanics must be the best person 
whom we can persuade to accept that responsibility. 

When we have chosen this individual for his competence 
in an occupation, be it on a professional or semiprofessional 
or trade level, we have taken only the first step in making him 
an adequate teacher, for he still has the problem of learning 
how to teach that occupation, he still has the problem of find- 
ing out what it is all about, what this new vocation in which 
he is engaged really means. He still has the problem of 
establishing all of the subtle personal relations and public 
relations that are involved in such a program. Under condi- 
tions as they are today, with an apparent rise in the demand 
for skilled workmen and skilled craftsmen on the trade and 
semiprofessional levels, you are not surprised to read in the 
New York Times every so often that the director of voca- 
tional education of this city or the director of vocational 
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education of a given state finds himself blocked because there 
is an inadequate supply of men trained to do the job and 
willing to come into the teaching fraternity. 

The same thing is true when we consider the personnel that 
have to do with induction, because there are peculiar require- 
ments to be met. We might take more time, if it were neces- 
sary, to discuss problem three, but you see it in its fullest mea- 
sure, I am certain. 

Problem four is to maintain satisfactory relations with em- 
ployers and with organized labor. If you have ever dealt 
with any program of occupational adjustment, you know that 
at the end there always was a group who was to pay a wage 
or a salary to the individuals you had trained. Increasingly 
as the years have gone by, particularly in the last decade, you 
have worked with some sort of organization, whether it was 
an A.F. of L. or C.1.0., or some other comparable group of 
organized labor. This problem is fraught with some of the 
most serious difficulties in the satisfactory carrying on of a 
program of occupational adjustment. 

The most significant way to solve it has seemed to be 
through what we have called the advisory committee relation- 
ship. Such a relationship implies that, whatever the occupa- 
tion be, there is always as part and parcel of the program a 
small, selected group of individuals made up of representa- 
tives of employers, labor, and public education who shall in- 
deed be the closest advisers of those responsible for the pro- 
gram. Over and over again, I have seen dilemmas, which 
would apparently wreck a going program on a secondary 
level or in a junior college, adjusted because back of the pro- 
gram there was this quiet, simple, unassuming group of per- 
sons who had had a share in the setting up of the program, in 
its development, in all of the various details which made up its 
organization. I have heard with my own ears, in a union 
labor meeting, a criticism of a program on a trade level in 
which someone, ill-informed, stood up and made an attack 
upon “what was going on down in the trade school. They 
were training youth there to take the bread out of workers’ 
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mouths, putting twice as many workers in the field as should 
be put in.” I have seen the representative of the advisory 
committee rise to his feet and say to the speaker, “You just 
don’t know what you are talking about,” and then proceed to 
tell from the inside what the facts were, and resolve a difficulty 
which, under the circumstances, could have become a major 
calamity in the public relations of that group. 

Problem five is to derive the utmost value from state and 
federal agencies without losing the power inherent in local 
governmental units. If you are acquainted with the program 
of occupational education, you know that the most significant 
development in this area has been the increase in state and 
federally aided vocational programs in the last twenty-two 
years. Starting in 1918 with a sum of $7,000,000, to be 
matched by an equal number of dollars on the part of states, 
this program has grown through additions to the Smith- 
Hughes law until the recent passage of the George Dean law, 
which increased the amount of the original $7,000,000 by over 
$14,000,000, making altogether available from federal 
sources approximately $22,000,000. 

When we know that over the years each state has appro- 
priated on an average of about three and a half dollars to 
match every dollar which came from the federal government, 
by a simple process of arithmetic we can arrive at a figure of 
approximately $75,000,000 which is spent each year on salar- 
ies alone. The above amount does not include the money 
which communities have spent themselves upon buildings and 
equipment and other expenditures, which are not legitimately 
to be reimbursed from state or federal funds. So it is not 
unfair or inaccurate to state that, this year, somewhere be- 
tween $100,000,000 and $125,000,000 probably will be 
spent upon one form or another of vocational education in 
this country, a little more than the price of one good battle- 
ship, but nevertheless a sizeable sum of money. 

The problem is to realize the utmost of value from all the 
impetus which comes from the availability of such vast sums 
of money, to use to the full the wise and sagacious counsel 
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from the central offices in Washington and in the state capitals, 
and yet, at the same time, not to allow the resident power 
which is always in communities to be lost or dwarfed by the 
process. 

There are so many agencies in government now that im- 
pinge upon this problem. I mentioned by implication the 
Division of Vocational Education of the United States Office 
of Education in Washington. There has lately been added to 
that office a new division called the Occupational Information 
and Guidance Service, which promises to be a very effective 
agency in the realm concerning which we are generally speak- 
ing. There is the United States Employment Service, resident 
now in the new Division of Social Welfare, which particu- 
larly through its Division of Standards and Research has con- 
tributed to our knowledge and experience in the adjustment 
of adults especially, in a truly marvelous fashion. 

There are the state employment agencies which work under 
the general direction and in cooperation with this United 
States Employment Service. There is the new Occupational 
Outlook Service in the United States Department of Labor, 
which promises over the years to give us some of the informa- 
tion in terms of long-range trends and tendencies which we 
have never had before. In the same Department of Labor 
there is the Federal Committee on Apprenticeship. There 
are the 4-H Clubs in the Department of Agriculture. There 
are the home demonstration agents in the Department of 
Agriculture. There are many others. So I might go on, 
calling your attention to these very helpful agencies which 
have their centers in Washington and in our various state 
capitals. 

Problem six is to meet intelligently the issues involved in 
the occupational adjustment of adults. I have been talking, 
up to this point, as if our problem were solely concerned with 
youth, but I would be in error if I did not point out that one 
of the most perplexing and continuously changing problems in 
this whole realm of occupational adjustment has to do with 
adults. 
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There are all sorts of conditions under which the adjust- 
ment problem arises. There is a simple one present in most 
occupations, whether they be high or low, of keeping in step 
with the procession of discoveries and inventions in the field. 
There is the whole realm of maladjusted adults. Sometimes 
one is maladjusted in terms of economics—he is unemployed 
through no fault of his own. Sometimes it is in terms of 
technology—when a machine comes along and in one fell 
swoop, as it were, eliminates the occupation to which hitherto 
a man has been giving his best efforts and intelligence. Some- 
times it is efficiency—a combination of factories under one 
general head eliminates a considerable number of workers. 
Sometimes it is accident, and accidents reach astounding pro- 
portions in this country—and a man who the moment before 
the accident was a competent worker in a given occupation 
becomes instantly a helpless, maimed creature, absolutely pre- 
vented from that moment forward from earning any liveli- 
hood at the trade which hitherto he has followed. Sometimes 
it is just plain, ordinary discontent—being “fed up” with the 
work one is doing, whatever it is. 

The total gamut just described is part of our problem—it 
involves selection, training, induction into work. It requires 
analysis, a program of rehabilitation based thereon, and a 
following through to a satisfactory conclusion, just as defi- 
nitely as for youth. 

Problem seven is quite a different problem, but I bring it to 
you because here is one of the groups vitally concerned with 
it. I have worded it thus: To resolve the foolish controversy 
between general or liberal education and vocational education 
Or occupational adjustment. There are too many persons in 
high places who are trying to drive deeper the wedge of 
division between these two absolutely essential aspects of 
modern education. They are not really antagonistic. They 
are mutually supporting objectives, each of the other. 

I would point out to you, however, that the tendency of 
all vocational programs is to become general—that normal 
schools, teacher training institutions, have too frequently 
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become four-year colleges, granting the liberal arts degree, 
and have in the procession, gradually lost their professional 
objectives and become something else. I have seen over and 
over again a vocational high school that started out with 
high purpose, becoming nothing more than a college prepara- 
tory school or a so-called technical high school which was a 
preparatory school for engineering. I have seen junior col- 
leges in the West, which I know best, starting with high 
purpose on their level, and under the influence of higher insti- 
tutions, gradually deserting all objectives but the lower divi- 
sion of the four-year college course. I have seen vocational 
teachers carefully selected with keen appreciation of what 
their job was, under the slow but subtle deadening tendency 
which is involved in that which I am speaking about, change 
from practical teachers of occupations into the most academic 
of academicians. 

This is one of the most subtle problems in the whole realm 
of occupational adjustment from above and below, and until 
we resolve this controversy and face the fact that each is 
interdependent upon the other, we will be hindering the best 
and most significant accomplishment in both areas. 

The last problem is to keep occupational adjustment pro- 
grams resting on the solid basis of research. Such matters 
as the determination of what courses to offer in vocational 
schools or in junior colleges or indeed in higher institutions, 
must be based more and more upon careful scientific investiga- 
tion. The curriculum through which those occupations are 
taught is in itself a research problem. Possibly one of the 
most significant contributions which vocational education has 
made to education in general is the job analysis approach, with 
certain modifications which common sense has led us to impose. 

There is the whole problem of supply and demand of 
workers at all levels. There is the problem of trends, which 
I have already mentioned—the long view as well as the im- 
mediate one. What is happening, for example, in agriculture, 
or in the home, or in business? What have invention and 
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technology to do with this problem? What have such phe- 
nomena as population changes to do with this problem? 

All these and others are involved in the mysterious and 
almost indecipherable mass of material which we try to in- 
terpret in order to portray the trends which seem to be evi- 
dent. This research approach, of course, includes the whole 
problem of evaluation—keen, ruthless scrutiny of what we do 
so that we can say with some certainty that what is stated in 
our objectives is actually being carried out. 

It is interesting to know that in connection with a commit- 
tee on which I happen to be serving at the present time, whose 
responsibility it is to find the significant researches going on 
in this field throughout the country and evaluate those re- 
searches, we are having some difficulty in finding any con- 
siderable number of significant studies of this kind. Only a 
few are being prosecuted, and those few in some ways seem 
rather insignificant in view of the implications involved. 

Let me conclude by telling you of an experience which I 
had just two weeks ago, which may seem remote from what 
I am discussing. I sat next to Julian Bryan in Duluth just 
two weeks ago today. Mr. Bryan, as most of you know, is 
a free-lance photographer and correspondent. At the time, 
he had just returned from Europe and had come to Duluth 
for his first public appearance of the year. He had had the 
most unusual experience, as you may imagine, which can come 
to a correspondent, for he was the only photographer and 
newspaperman in Warsaw during the entire bombardment. 
Some of his pictures have already appeared in Life and Time. 

A group of us around the table were talking about these 
experiences, and Mr. Bryan said something like this: “You 
may wonder what a man thinks about under such circum- 
stances. We were, all of us, perfectly sure that we would 
never get out of Warsaw alive. It was a certain conclusion 
that sooner or later our turn would come. What did we do? 
Well, there were a few who became hysterical and temporarily 
insane; and there were others who, under the stress of these 
circumstances, took refuge in liquor and drank themselves 
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into insensibility day after day to escape the reality. But 
most of them did as I did. 

“On the morning of the second day, I said to myself, 
‘Julian, here you are in a situation which any correspondent 
would give his very life to be in. You have five thousand feet 
of film, you know how to photograph, you had better go out 
and take some pictures.’ So I solved my problem of what to 
do under circumstances in which I had no hope of ever getting 
out alive by doing the thing I knew best how to do. 

‘“‘T found the same thing was true all over the city of War- 
saw. I went down one day to broadcast from the central 
station. That station was above all the one place the German 
bombers wished they could find and hit. It was the most 
dangerous place to be in the city and I was glad to get out of 
there after fifteen minutes. But the men and women who 
worked in the broadcasting station stayed there until the end, 
because their most certain security of mind and body and spirit 
was in doing the thing they knew best how to do. 

‘“‘And so it was with the great majority of the population. 
The telephone girls at the switchboard stuck to the switch- 
board; the men who cleaned the streets cleaned the streets 
and dodged when the bombers came; the clerks in the stores 
served the customers, and after a few hours of terror, each, 
in order to save his soul, went back to the work which he knew 
best how to do.” 

After all, that is the basic truth which is implicit in the 
topic I have been discussing with you, whether a man’s work 
be on the professional level or the semiprofessional level or 
even in the most lowly and menial of occupations. 





The Testing of Comprehension 


By LOUIS C. ZAHNER 


EFORE taking up the details of any theory of meanings 
B= discussing the implications that these may have for 

testing, we should consider one or two facts about test- 
ing in general. These will be platitudes; but I mention them 
here because they form the background of what we shall go 
on to examine. 

First, testing influences teaching. Back in the days when 
the College Entrance Board set questions on Silas Marner 
and 4 Tale of Two Cities, these became for English teachers 
everywhere the canon of the English novel. The restriction 
was removed twenty-five years ago; but still, for hundreds of 
school children, the English novel means these two books. Or 
the College Board begins to test comprehension by a précis 
question; and almost overnight teachers accept the idea that 
the précis is the one method for teaching comprehension. 

Here the influence was direct; it might even have been pre- 
meditated. Silas Marner, in his prime, was a college entrance 
requirement. But it is not only what is directly tested that 
has such powerful influence; it is also what is implied in the 
testing. The principles, theories, and postulates behind the 
testing exercise upon teaching an influence more subtle, more 
dificult to appraise, but fully as potent. The fact that the 
influence is unpremeditated and unrecognized makes it poten- 
tially an even greater danger. If, in a mathematics testing 
program, for instance, there were an implication that two 
plus two equals five, mathematics teachers might soon begin 
teaching that two plus two equals five and that three plus 
three equals seven. If, in a set of tests given for a long 
enough time to a great enough number of pupils, there is 
an implication that only certain things should be taught, these 
things will be taught to the exclusion of others. If, in tests 
on comprehension, some theory of language lies hidden, 
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teachers will teach, unconsciously perhaps, on the foundation 
of this theory. It is not necessary here to go into the reasons 
for this being so. Certainly the great testing agencies are 
sincere in their disavowal of any intention to influence teach- 
ing. If we smell a fault, it is probably the fault of teachers 
and administrators. We may deplore the fact; but we can- 
not ignore it in any realistic talk about teaching and testing. 
Nor do I believe that we can change it. The testing agencies 
must accept the fact, and the grave responsibility that goes 
with it. 

Our second platitude is this: Many of the tests that we 
call “objective” today are not objective at all, or are objec- 
tive only in a special and limited sense. If we mean by 
“objective test” a test that does not involve any opinion or 
value-judgment, expressed or implied, on the part of the test- 
maker, the test-taker, or the test-grader, then few of our tests 
are fully objective. A test in the ordinary operations of 
mathematics or in the established facts of history would be 
examples of tests most nearly fulfilling the requirements of 
this definition. An item, for instance, asking a pupil to decide 
whether the Magna Charta was signed by King Henry, King 
Richard, King John, King George, or King Cole would be 
an objective item in the sense that the keyed response, King 
John, does not express or imply any opinion or value- 
judgment on the part of the maker, taker, or grader of the 
test. Even here, however, we should perhaps note paren- 
thetically that a test composed of such items involves a sub- 
jective element at an important point. The constructor of 
the test must form an opinion as to what items would con- 
stitute the best coverage of the field being tested. He can, 
of course, poll the opinion of a great number of competent 
teachers on this point, and he can give to proposed items 
scores based upon the teachers’ replies, including in his test 
only those items that, say, at least 80 per cent of the teachers 
approve. But each teacher’s vote represents a subjective 
opinion; and an addition of subjective opinions, however 
dressed up in figures and percentages, does not make an 
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objective fact. Taken by itself, however, an item like the 
Magna Charta item is objective. 

An item like the following, on the other hand, cannot be 
considered objective in the same three-fold sense: 


Which character is Shakespeare’s greatest creation? (1) lago; 
(2) Aaron; (3) Petruchio; (4) Falstaff; (5) Prince Hal. 


Here, clearly, there is implied a subjective opinion on the 
part of the maker of the test. I do not happen to know the 
keyed response for this item. Let us assume that it is “Fal- 
staff.”” One hundred per cent of ten thousand teachers of 
English might make this response. But here again our prin- 
ciple applies, and a summation of subjective opinions does 
not make an objective fact. The item would still be sub- 
jective. The pupil taking the test, moreover, must make a 
subjective judgment. He must make it in a strait jacket, to be 
sure, but he must make it. He may believe that Hamlet is 
Shakespeare’s greatest creation; but if he is a wise child, he 
nips this bit of critical heresy in the bud, and tries to decide 
which is the greatest creation among those given. Two sub- 
jective judgments, so far, then, are involved in the progress 
of this item—that of the test-maker and that of the test- 
taker. It is an objective item only in the last and least step, 
that taken by the grader of the test. He records only the 
objective fact that the taker has made a certain response. The 
item is duly scored, and added into a total score that has every 
appearance of being an objective measure. This particular 
item, however, does not measure the familiarity of the testee 
with the facts of Shakespeare’s plays; it does not measure his 
power to form valid and independent critical judgment based 
upon knowledge of fact; it simply measures the way in which 
his subjective opinion happens to coincide with the subjective 
opinion of the tester. This situation would not be particularly 
serious were it not for the fact that the word “‘objective” has 
acquired an aura of validity unquestioned and unquestionable. 
If we call anything in these days “‘objective’’ we accept it as 
scientific, good, true, and final. We need a term for these 
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tests that is more accurately descriptive of what they really 
are, and less charged with overtones and suggestions of 
infallibility. I can think of no single adjective that exactly 
fits. Perhaps they would be described with fair accuracy if 
we should call them “‘fixed-response tests.” 

These, then, are my platitudes: testing influences teaching; 
fixed-response tests conceal a vast ingredient of subjective mat- 
ter. [| am tempted to call these platitudes axioms, for I believe 
that they and similar truths should be at the base of all our 
thinking and reasoning about tests and testing programs. If 
they have any validity at all, they point to several conclusions. 
The one that I should like to stress for my present purposes 
is this: Wide testing programs based on fixed-response tests 
are better adapted to some fields of learning than to others. 

A field of learning to which a fixed-response test is well 
adapted would have these characteristics: 

First, it would be a field in which the theories and prin- 
ciples implied in the fixed-response type of item do not run 
counter to the sound theories and principles of the subject 
matter. If it were not possible, for instance, to construct a 
mathematics test without the implication that two plus two 
equals five, the test would not be well suited to that field. 

Second, it would be a field that has a reasonably satisfactory 
and well-recognized body of content as a school subject. If 
mathematics teachers, for instance, are not yet agreed as to 
whether the multiplication table and the process of long 
division are proper material for the school curriculum, it would 
be still too early for the tests to move with confidence into 
this field. 

Third, as a school subject, the field would have a com- 
petent body of teaching materials and methods. Tests, vali- 
dated as they are on existing tests, and so on back to existing 
materials and methods, have a tendency in education toward 
conservatism. They give authority and momentum to current 
practices, fortifying bad practices as well as good. Ina field 
in which practice is not well established on sound principles, 
therefore, or in a comparatively new teaching field that is 
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undergoing a good deal of experiment, tests should move with 
delicacy. Otherwise, they may be testing what may not be 
worth perpetuating, and they may be helping to perpetuate it. 

Fourth, as a classroom subject, such a field would contain a 
high ingredient of objective, factual material. If tests are 
factual, teaching will be factual. This is, of course, particu- 
larly true in fields in which the objective test is the only or the 
chief testing instrument. The proportion of factual to sub- 
jective material in a testing program will be closely reflected 
in a teaching program. 

Fifth, in such a field, a considerable proportion of the really 
significant material would be amenable to reduction into short, 
fixed items which admitted of right-or-wrong and quick 
response. 

By a short, fixed, quick response, for instance, we can test 
well enough the pupil’s knowledge of the date of the Norman 
invasion. If, on the other hand, we are examining his under- 
standing of the causes that underlie the present war, the 
short, fixed response will hardly do. If teachers of history 
believe that in their field the importance of factual material, 
like dates, on the whole outweighs the importance of material 
that cannot be briefly fixed and stated, then history would be a 
subject answering this last requirement. If, on the contrary, 
they believe that the opposite is true, then fixed-response tests 
by themselves can hardly be considered adequate or suitable 
for that subject. 

In a field of learning that has all these five characteristics, 
fixed-response tests are valid and useful. Ina field of learning 
that has few or none of them, unless great care and discretion 
are exercised, fixed-response tests may become an educational 
liability. 

Now let us look at the subject of meanings and comprehen- 
sion. Have we here a field that meets the requirements we 
have laid down? First, are the theories of language implied 
by the fixed-response tests consistent with sound principles of 
meanings? I believe that this is extremely doubtful; we shall 
examine this point later at more length. 
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Second, in the teaching of comprehension, have we any 
reasonably satisfactory and well-recognized body of content? 
I believe not. We have not analyzed or systematized the 
theoretical side of language well enough as yet to be sure 
of our grounds in setting up a course of study in the schools. 

Third, have we a competent body of materials or methods 
for teaching comprehension? I believe not. All we know for 
sure is that we have been teaching what has gone as gram- 
mar and rhetoric for years and years, and the universal cry 
still goes up, “Your pupils cannot understand what they read.” 

Fourth, have we in this subject a high ingredient of factual, 
objective materials? I believe not. This, again, we shall ex- 
amine later in more detail. 

Finally, have we here a subject that has a large and sig- 
nificant body of material that is reducible to short, quick, 
fixed-response testing items? Again, I believe that we have 
not; to this point, also, we shall have to give closer attention. 

Before we can answer with any degree of fairness the three 
questions we have put off for further study, we must make a 
realistic examination of some of the principles of language, 
or, if we wish to use less pretentious words for what we are 
doing, let us call it simply an examination of the ways in which 
words work in human life, both in thinking and in communi- 
cation. For this is all we can mean by “the principles of 
language.’ They are not principles in the sense of being pre- 
ordained codes of right and wrong, but rather in the sense of 
being generalizations we can attempt to draw from obser- 
vation. We can hope in the time at our disposal here to make 
only the most cursory, incomplete, and superficial examination. 
We must, moreover, for purposes of discussion, treat even 
these few elements of the operations of language as if they 
were separate or separable in practice, when, as a matter of 
fact, in language-in-use all of these elements are involved at 
once, and in varying and intricate patterns. But even such 
a hasty overview of the workings of language may help us to 
understand a little better some of the problems faced by read- 
ing and comprehension tests. 
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The first thing we notice if we examine our daily run of 
reading (or listening) or writing (or speech) is that language 
can convey many different kinds of meanings. First and most 
obvious, there is the plain sense of the words used. The plain 
sense of what is said we may call the actual situation to which 
the words refer. If the words are being used literally, the 
plain sense does not lead us beyond this literal meaning. If 
we say, for instance, “There is a fire burning in the grate,” 
the plain sense of the words is what they convey about the 
fire, the grate, and their positions. If the words are being 
used metaphorically, the plain sense is still the actual sit- 
uation to which they are intended to refer; but it is likely to 
be more difficult to arrive at an understanding with any 
certainty. When, for instance, Thomas Browne says: “Life 
is a pure flame, and we live by an invisible sun within us,” 
his sense-meaning is still the sum of the actual things he is 
saying about life. It is clear that he is making not one state- 
ment about life, but many, some of which are hardly more than 
suggestions, and it is equally clear that no two people here 
would put exactly the same sense interpretation on his words. 
We should even disagree as to whether the plain sense-mean- 
ing is the most important part of what he has written. 

What are some of the other parts or elements of the total 
effects that words can convey? What would drop out of the 
sentence I have just quoted, for instance, were we to trans- 
late it into a series of statements such as, “‘Life is mysterious. 
Life is not a material substance. We cannot see the source of 
life.’ We have lost all effect that Browne’s words may have, 
to express or to evoke any feelings about life. We need not 
labor such an obvious point. No one would question the 
emotive power of words, or would hesitate to include the feel- 
ings conveyed, along with the plain sense, as an element of 
the full meaning. 

Closely allied to the power of words to evoke or express 
feelings is their power to express the attitudes of the writer, or 
to influence the attitudes of the reader. In much of what we 
write or say, our main purpose is not to convey information, or 
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to arouse feelings, but to indicate how we are disposed toward 
our subject, or our audience, or the world in general; or to 
influence our audience to hold certain attitudes toward us, or 
themselves, or the subject. Although propaganda and adver- 
tising are by no means the only kinds of discourse in which 
this element of meaning is uppermost, in these days they fur- 
nish us with ready and clear examples of what I mean. 

It follows even from this sketchy analysis of meanings that 
it is always pertinent for the reader to understand the intent 
of the writer. In competent reading, the old rhetorical 
division of purpose or intent does not give much help. It does 
not get us far in our interpretation of the writer’s meanings 
to answer the question, “Is this piece of writing narration, 
description, exposition or argument?” A more telling ques- 
tion is, “What is the writer, in the main, trying to do here— 
to render in words the plain facts of a situation, to express 
his feelings or to arouse mine, to let me know his attitudes, 
or to get me to form attitudes?” We shall almost always 
find that all these things are going on at once, in a highly 
complex way. They are not in physical, but in chemical and 
organic combination. Each element acts upon, and lives upon 
the others. In face-to-face speech the tone of voice and 
gesture will carry many of the nuances of meaning. In 
reading, we are left to decide for ourselves the tone of the 
passage. Reading for comprehension demands the ability to 
deal with all these elements in all their multitudinous and 
complex interrelationships. 

We have looked briefly at the kinds of meaning a word may 
have. We must now ask ourselves an even more funda- 
mental question. How do words get these meanings? Out 
of a dictionary? If so, how did they get into a dictionary 
in the first place? By common consent of the “best authors”’? 
If so, what is a “best author,”’ and where did the Adam of 
“best authors” first get his words and their meanings? 
Through “common usage’? This seems nearer to a tenable 
answer; but it is still not completely satisfying. Where does 
‘common usage” originate? If “common usage’’ fixes the 
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meanings of words, will not someone let us know what is the 
“common usage” meaning of these abstractions we have 
heard so bandied about, “neutrality,” and “isolation,” for 
instance? Does ‘common usage’”’ help us fully to understand 
these? 

Words get their meanings for us only through our ex- 
perience. If we have never experienced the thing for which 
the word stands, it can mean nothing to us. A word which 
for us has no roots in experience must be broken up and 
expanded into words which we do understand in terms of 
experience. If a city child—this is an actual case—does not 
understand the word “farm,” it is not because his dictionary 
is a bad one, or because the “‘best authors’? have not been 
farmers, or because he is putting a meaning on it contrary 
to that of “common usage.” It is simply because he has 
never been out of the city. He could best be taught to 
understand the word by a trip to the country. Failing that, 
a teacher would have to do his best with pictures, with things 
like the grass in the park, and with words like ‘‘animal,” 
“eggs,”’ and “birds about the size of your head that don’t fly 
very well.”’ Even so, the word will actually have a different 
meaning for the city boy and for the country boy. 

This is a crude example of a general truth. No word 
means exactly the same thing to any two persons, because no 
two persons have had exactly the same experience. A word, 
for each of us, stands for the thoughts or ideas we have 
formed in situations of which that word has been a part. 
This total thought for which the word stands, different in 
the mind of each of us, is, for us, its meaning, or, rather, the 
sum of its possible meanings. This, roughly, is what is 
sometimes called the “psychological context” of the word. 
It is, so to speak, the well of meaning into which we dip 
when we see or hear or use the word. Its exact meaning, 
Or meanings, in any particular situation in which it is used, 
depends upon the total setting in which it then appears. 
Thus, the word “dust”? which has a psychological context 
formed by experiencing the word and the thing, has one 
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meaning if I say, “I am dusting a piano,” and exactly the 
opposite if I say, “I am dusting an apple tree”; and ‘‘home,”’ 
a word with a rich psychological context, will have quite a 
different and special meaning in the settings “home office,” 
“home plate,” “Go home, Fido!’’ and 


“Home is the sailor, home from the sea, 
And the hunter home from the hill.” 


The last example suggests the further point that not only 
the sense-meaning is controlled by the setting, but also the 
other meanings. The feeling, the tone, the attitudes, the 
intent, are all controlled by the whole situation. The clue 
to this is the context in its more usual and narrow sense, that 
is, the other words printed on the page. 

Before we go back to examine further the questions we 
raised about testing, we must consider one more aspect of 
language in a little more detail. Any one of the elements of 
meaning that we have touched on is in itself a field for 
further study. Let us look for a moment at meaning in its 
most obvious and most generally recognized form, that of 
the sense-meaning. This inquiry is pertinent to the question 
of testing comprehension, particularly as it sheds a good deal 
of light on the problems of the relative importance of objec- 
tive and nonobjective material in the language field, and the 
degree to which interpretation of meanings can be reduced to 
short fixed-response items. 

If in our thinking and communication we never had to 
manipulate any ideas except those that deal with physical 
objects, and their position and movement in space, there 
would be no great difficulty, either in keeping our thinking 
straight or in making ourselves clear to each other. We 
could always check our thinking empirically and quite directly 
by observation; and if necessary we could make our mean- 
ing clear by pointing, by use of pictures, or by trying other 
words, which would also refer to physical things, feelings, and 
actions. ‘“‘A fire is burning in the grate.”’ I can check this 
conclusion by seeing whether or not it is so; and if a listener 
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does not understand me, I can point, or draw a picture, or 
explain “fire” or “grate” in words that he does understand. 
But human life cannot get along at this simple level. We 
have to talk about general classes of things; we need at times, 
for instance, to refer not to separate chairs and tables and 
beds, but to furniture. We have to make generalized state- 
ments about things. Even here, we are fairly close to the 
solid ground of the physical world. But we cannot get along 
with only the names of things and the classes into which we 
have found it convenient to group them. Most of our think- 
ing and communication is much further removed from its 
base of actual physical realities, and if we are going to 
manage the everyday business of life, we must have words 
that refer, not to things, but to whole complicated sets of 
relationships and situations. We must deal with such 
abstractions as nature, law, neutrality, good English, society, 
the state, property, intelligence-quotient, and testing pro- 
grams. Verification of our conclusions and clarification of 
our meanings become vastly more difficult at this level than 
they were at the level of things. In these abstractions we 
gather together a complex set of ideas and attach to them a 
single name, like civilization. Under such a name, each of 
us, according to his experience, gathers a different set of 
ideas. Sometimes these are quite similar; sometimes they 
are as wide apart as the poles. We are so accustomed to 
seeing a name attached to every object that we need to talk 
about, that it is an easy and innocuous assumption that every 
thing has a name. From that we unconsciously go on to 
make the assumption that every name has somewhere a 
corresponding thing. This is a less harmless assumption. It 
leads us to suppose that we are talking about a same thing 
when we are using the same word. It hides from us the 
fact that most of the words we use have no fixed meanings; 
that even reasonably adequate communication is not easy to 
establish; that there is no guarantee that our reader puts 
our meanings on our words. It blinds us to the fact that we 
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ourselves unconsciously put one meaning on a word we write 
or speak one minute, and a totally different one the next. 

We extend our power to express meanings, then, by using 
words that stand for complex and shifting sets of ideas. 
We have still another way of extending our thinking and 
communication beyond the world of immediate physical 
things. This is metaphor. By metaphor we can suggest and 
express meanings that could be expressed only with great 
difficulty and at great length by any literal use of language. 
In some fields of thought, in fact, metaphor is our only 
means of expression. Talk about the mind, for instance, 
is impossible without metaphor. We cannot go far into an 
examination of metaphor here; for our purposes, it is enough 
to mention one or two facts about it. In the first place, it is 
no mere adornment of poetic language. It pervades all 
language, prose as well as poetry. It is no mere trick of 
style, no mere dressing up of effects. It conveys the mean- 
ing; in fact, it is the meaning. An understanding of the ways 
of metaphor is necessary equipment for intelligent compre- 
hension, not only in classes of English literature, where pupils 
read that “life is a brief candle,” but also in social studies, 
where they read of “the strains and stresses that we see in 
the fabric of society.” 

Now let us see what application these views of language 
have for the testing of comprehension. There remained 
from our five requisites of a field favorable for fixed-response 
tests three to be further considered with particular reference 
to language. Our tabled questions were, as you may 
remember: 


1. Are the theories of language implicit in the fixed- 
response tests consistent with these principles of language? 

2. Have we, in this view of language, a high ingredient 
of objective material in the field of comprehension? 

3. Have we, in language and meanings, a subject that has 
a large and significant body of material that is reducible to 
short, quick, fixed-response tests ? 
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The first question can best be answered by implication as 
we turn our attention to the other two. 

This concept of language being at various levels of remove 
from actual sensory experience is an important one for us 
to remember. Think, for a moment, of the different 
processes involved in arriving at a good comprehension of 
these two sentences, and of testing this comprehension: 


A stream-lined train bound for Chicago is rushing along the track. 
Civilization is rushing along the road that leads to destruction. 


The first sentence represents a situation in which physical 
things are the direct component parts. It is easily under- 
stood by anyone who has had any experience with trains, 
tracks, shapes, motion, and directions, and with the words 
and syntactical patterns used to talk about them. It is not 
a dificult problem of comprehension. We shall not, any of 
us, to be sure, place identically the same meaning on the 
sentence, because our experience even with these physical 
entities has been different. Our different experiences, how- 
ever, have overlapped sufficiently to insure communication 
adequate for our purposes. In testing comprehension, cer- 
tain fixed-response items could be devised quite easily. For 
instance: ““The train was, (1) backing into the station; (2) 
moving slowly; (3) leaving Chicago; (4) moving rapidly; 
(5) standing still.” Such items would test well enough the 
reader’s understanding of the passage, and they would, 
moreover, parallel closely the mental processes through 
which a reader gets an understanding of the passage. The 
item, furthermore, is an objective item; that is, it does not 
draw upon the unique experience of the test-maker or of the 
test-taker to such an extent that it requires a value judg- 
ment or opinion on the part of either. In one sense, it is 
little more than a matching of synonyms, a vocabulary test 
of a simple order, in which the words are given in a factual 
context rather than as separate words. For comprehension 
at this level, the fixed-response test is admirably suited. 

Now let us look at the second sentence, ‘“‘Civilization is 
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rushing along the road that leads to destruction.”” How are 
we, in the first place, as readers, to go about establishing 
communication here with the author? How are we to be 
sure, when we think that we have established communication, 
that we are putting on his words the meanings he puts upon 
them? “A good interpretation of a poem,” writes Richards, 
‘is a triumph against odds.” So is a good interpretation of 
any language which is not directly anchored to visible and 
tangible facts; any language, that is, that has a high content 
of abstractions or of metaphor. 

Where we can make our interpretation or our explanation 
in terms of things, almost by a pointing process, we have 
objective data that we can test surely and safely by fixed- 
response tests. Where, on the other hand, we move higher 
and higher into the level of abstractions, where our language 
becomes more highly metaphorical, we can no longer point 
to things and their relationships. We are thrown back, each 
of us, on his own experience, on his own good judgment. We 
no longer have objective data; reading and comprehension 
becomes a subjective, a creative, process. One further point 
must be made here; it is one of vast importance to education 
generally. It is simply this: Most of the difficulties in com- 
prehension that are of any consequence to education or to 
life gather around the interpretation of abstractions and 
metaphors. It is when we meet these singly or in combina- 
tion that the sense-meaning is elusive, and that the feeling, 
tone, intent, and attitudes of the writer are of special 
importance and of special intricacy. It is, moreover, in 
these higher reaches of language that most of our education 
of our pupils takes place, whether our subject is English, 
social studies, or even science. Interpretation of language at 
this level is necessary not only for the understanding of 
literary and rhetorical effects, but also for close, straight, 
logical thinking. The greatest task of education—both in 
teaching and testing—lies in the formation and clarification 
of concepts that belong in these higher levels of language. 

Does the process of comprehension yield material that 
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naturally can be reduced to short, quick, fixed-response items? 
It appears, rather, that condensation kills intelligent inter- 
pretation. Interpretation of almost any language that needs 
interpretation, or the interpretation of which is important 
to us, almost invariably demands verbal expansion. Defini- 
tion, whether of words or of things, calls for expansion. 
Ambiguities cannot be resolved until they have been stated, 
and their statement is a process of expansion of the two or 
more possible meanings. The same is true of the inter- 
pretation of abstractions and metaphor. 

The interpretation of abstract language, its comprehension, 
is the process of its formation in reverse. It comes into 
being by catching up complex situations and putting them 
together in one word. Its comprehension demands not a 
mere synonym translation, but an expansion into its com- 
ponent parts. Good comprehension, moreover, demands a 
particular kind of expansion; an expansion in terms that are 
operational, in terms that stand closer to the physical world, 
or to our feelings about the physical world. This process of 
expansion, or filling out in words, is, as we have said, dis- 
tinctly a subjective process. The experience of the reader 
must be matched against the experience of the writer. It 
requires the formation of judgments and opinions. It admits 
of few demonstrably right or wrong answers. 

Much the same can be said of metaphor. I have heard 
metaphor called an “explosion.’”’” This metaphor itself is not 
inapt. Metaphor is not an arrow that goes straight, hits its 
target with one clean shot, and stops and waits for us to pull 
it out; or else plainly misses it altogether. A metaphor ex- 
plodes. Pieces and smoke fan out in every direction. Some 
pieces hit unexpected targets; some hit none. Some we are 
not sure about. Next week we may be walking along far from 
the scene of the explosion and find a direct hit registered on 
a tree we had not noticed. Metaphor throws out meanings; 
it invites us to explore some whole subject anew. Its meanings 
are not static and fixed. Its essence is that it has no single 
meaning. Its interpretation is a nice process of judgment, 
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of weighing multiple interpretations. So, again, the compre- 
hension of metaphor calls for verbal expansion. Similarly, 
the understanding of general statements demands of the 
reader an expansion into specific illustrations from his own 
experience. 

The fixed-response test is subject to still another grave 
handicap in the field of language. The process of reading for 
comprehension, if comprehension is to be anything but super- 
ficial, is probably something like this: A reader, by a sort 
of preliminary survey of a passage, or, in fact, as he reads it, 
notices what kind of language is being used, and for what 
probable effects. He asks himself a series of running ques- 
tions, such as, “Is this language in the main factual or 
abstract? Is it literal or metaphorical? Is it intended pri- 
marily to give information, to arouse feelings, to create atti- 
tudes, or something of all three. What are the key words, 
and what the crucial metaphors that I must expand? Is this 
sentence a statement of fact, a description, a statement of 
opinion, or a definition of a thing or of a word? Is it a 
generalization or a specific statement? Does good reading 
of this passage demand an empirical check; if so, what sort 
of check is appropriate, and how shall I make it? Has this 
word, this sentence, this whole passage, several possible inter- 
pretations of its sense, its tone, its feeling? If so, what are 
they, and which meaning, or multiple meanings, are probably 
those intended?’ Not every question is asked about every 
passage; but the process of comprehension is a process of ask- 
ing questions and answering them. The art of good reading 
is the art of asking the right questions. The craft of good 
reading is the ability to apply the techniques for answering 
the various questions that the reader asks himself. The 
difficulty here is, of course, that the test-maker asks the ques- 
tions. We are leaving out of the testing situation what should 
be the most important element in it: the ability of the reader 
to ask himself a good set of questions about what he is read- 
ing. I can tell how well I think a reader has understood a 
given passage (by which I generally mean, I can see how 
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closely his understanding coincides with mine) by seeing what 
test he would write upon it. But I cannot be sure of the com- 
prehension of the person who takes this test. We should all 
agree that tests should be made out by good readers. But 
then we are in trouble; for a passage that has had significant 
questions asked about it is three-quarters read already. The 
ability to answer the questions set by some other reader by no 
means is the same thing as the ability to ask one’s self a sig- 
nificant set of questions. 

I spoke earlier of the fact that testing influences teaching, 
and that in a subject not as yet well established as a teaching 
subject, tests may exert a bad influence. There is some danger 
here, I believe, in the whole subject of language and compre- 
hension. In addition to the dangers at which I have already 
hinted, there are one or two others that should be taken into 
account. Teachers, under the influence of too wide and undi- 
versified objective testing of comprehension are likely to 
believe that the teaching of comprehension should be heavily 
weighted on the side of understanding purely factual lan- 
guage. ‘They are likely, moreover, to believe that the same 
technique can be used for the understanding of abstract, and 
metaphorical language, that can be applied to factual lan- 
guage. Interpretations that should call for subjective opinion 
are too likely to be dealt with by teaching the pupil some stock- 
response. Richards, on the basis of his experiments at Cam- 
bridge University, holds that the implanted stock response is 
responsible for much of the student’s failure to understand 
what he reads. Subjective material treated as if it were objec- 
tive material leads inevitably to the implanting of the stock 
response. 

Again, under the influence of long tests composed of short 
items, teachers and pupils alike are in danger of getting the 
idea that in reading we can understand without regard to a 
considerable context; and that we can comprehend anything 
we read without much thought or meditation. They are, 
moreover, likely to absorb the idea that a large dictionary- 
vocabulary is all that we need for good reading or writing, 
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and completely to fail to see that it is not the number of words 
that count, but the control that we can exercise over the words 
we have. 

Before we go on to a discussion or documentation of the 
issues I have raised, I should like to make myself unmistakably 
clear on one point. It is only the shortness of the time left to 
us that prevents my giving it the space it deserves. It ranks 
in my mind as of equal importance to all that I have said. 
It is simply this: In this question, I do not take a defeatist 
attitude. If I have made a somewhat detailed analysis of the 
natural difficulties that objective tests face in the field of lan- 
guage and meanings, it is not to advocate the retreat of these 
tests from this field. In these days, nothing could be more 
foolhardy. Quickly administered, inexpensively and uniformly 
graded tests have won their undeniable place in our educa- 
tional system. I have examined these difficulties not because 
I think that they cannot be met, but rather because I am sure 
that they can be met; in fact, a beginning has already been 
made in meeting them. I think that we should all agree, how- 
ever, that they can be fully met only when they are fully 
realized and understood by teachers and test constructors 
alike. Above all, it is of primary importance that teachers 
and the makers of tests work from the same basis of theory 
and principle. Much of the criticism that I may have seemed 
to level at the test-makers belongs properly at the door of 
us teachers. The testing agencies test what teachers teach. 
If teachers and those responsible for tests work together, in 
a spirit of cooperation, and at the same time base their work 
on a common ground of belief, nothing will turn out to be 
impossible. 

I said a minute ago that the influence of tests is generally 
conservative; that tests tend to fortify whatever is present 
practice. In a well-established field, this is reasonable and 
right. In a field like this one about which we have been talk- 
ing, it is understandable; but it is dangerous. If teaching is 
bad, test items that conform to existing norms may simply 
reflect (and fortify) bad teaching. New items, on the other 
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hand, that seem to the test-maker to be based on a more valid 
theoretical foundation, may annoy teachers and bring out-of- 
line results that would make them appear at first to be bad 
measuring instruments. But they might test something better 
worth testing, and eventually they might influence teachers 
to teach what is more worth teaching. 

There is no logical reason why testing should inevitably 
follow teaching. In a field in which exploration is only just 
beginning, testing can and should lead. This requires courage; 
for, until enough teachers have caught up, tests that blaze the 
trail for teaching cannot be expected to achieve high coefh- 
cients of validity or reliability. Pioneering always does de- 
mand courage; and there is pioneering to be done, lots of it, 
in this field—or tropical jungle—of language and meanings. 
When the jungle does finally become a field, we shall find, 
I am confident, that the makers of tests have been first among 
the pioneers. 





Perspective upon Education 
By HENRY M. WRISTON 


T IS one of the tragedies of human life that in the midst 
] of battle men think they understand the issues for which 

they are fighting. An interesting book by Dr. Cabot was 
entitled What Men Live By. Some one should press further the 
observation of Antoine de Saint Exupéry in Wind, Sand and 
Stars on what men die for. All too often men have laid down 
their lives for false issues, because the heat of battle generates 
its own issues and so confuses perspective that when the war 
is over, even a victorious war, the peace seldom conforms 
to the original objectives. It deals instead with new issues 
which have arisen out of the conflict itself. The longer the 
war is carried on, the more perspective is obscured. Victory 
becomes an end in itself instead of an instrument, and the 
cessation of fighting seems a good in itself rather than an 
opportunity so to organize our lives as to avoid fighting again. 
It is significant that we celebrate Armistice Day, but no one 
pays the slightest attention to the day when peace was pro- 
claimed. Perhaps that is why the “‘peace” proved to be only 
an armistice after all. 

Since the last World War there has been a stream of self- 
justifying memoirs published by those who held conspicuous, 
if not decisive, positions. They have some value, but almost 
inevitably they are egocentric and seek to create or to solidify 
some myth regarding a particular individual. When all such 
books have been read, one realizes that the actions of the 
authors in wartime are more revealing than their apologetics 
are convincing. There has been another stream of books of 
which Ernest Hemingway’s Farewell to Arms, Remarque’s 
All Quiet on the Western Front, Zweig’s The Case of Ser- 
geant Grischa, and Anderson and Stalling’s What Price Glory 
are typical. These books are not explanations but denuncia- 
tions, underlining the point that desperate as were the en- 
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counters, bloody and terrifying as was the fighting, so far as 
achieving the original objectives was concerned, it was a 
sham—not a sham in the movie sense, wherein men mowed 
down by machine guns leap up at the call of the director to 
be mowed down again in a better light, but sham in the sense 
that the war was actually about other things than those which 
precipitated it. 

The current world situation makes this an appropriate 
moment to suggest that there is something to be learned from 
war experience in connection with our educational battles. 
As it is in the war with mechanized weapons, so is it also in 
the battles fought with those yet sharper instruments—words. 
As debate proceeds, one disputant often allows himself to 
be diverted in order to meet his opponent’s arguments, even 
when they are bad. Slowly but almost inevitably each of the 
antagonists takes a new position, not in response to his own 
positive and constructive thought or even by conscious choice, 
but in the effort to defeat his adversary’s reasoning. The 
new ground is frequently chosen upon negative considerations 
and without reference to any positive educational philosophy. 
Indeed, before they are through the verbal combatants not 
infrequently have exchanged positions. 

Certainly educational factions have fought a war—at least 
in the headlines. The functionalist, the vocationalist, the 
instrumentalist, the psuedo-democrats who were regimented, 
the psuedo-liberals who would put us into a mold, and the 
pseudo-conservatives who are more radical than any others, 
have all made, not the nights alone, but the days, hideous with 
their outcries against each other in the public press. Read- 
ing these discussions might lead one to suppose that confusion 
in higher education is so hopeless that there are no generally 
accepted objectives at all. 

It has always been clear that those who asserted, ‘‘We are 
the people, and wisdom will die with us,” were able to show 
suspiciously small erosion of their thresholds. One highly 
publicized plan after another has thrived in the press and 
languished in the classroom. Sometimes, perhaps, it has 
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been because prophets are not without honor save in their 
own country; more often it has been simply the inevitable 
reaction to a false alarm—much running to the scene by the 
curious but a waning of interest when not even smoke was 
perceptible. The students who came to the well-advertised 
institution were not those described in the prospectus. One 
of the most widely discussed of the experimental colleges de- 
sired the ordinary student, or as the president expressed it, 
“the run of the mine.” But its program appealed to the 
adventurous, and during its brief existence it never could cap- 
ture enough “ordinary” students to validate its theory. 
Among all its revelations, the Pennsylvania Study showed one 
thing with perfect clarity. In some manner, the mechanics 
of which we do not understand, each college tends to get the 
kind of students it really wants and deserves—not necessarily 
those it describes. This suggests we should look behind the 
slogans and war cries for the realities in the educational world. 

That is what I want to do tonight. Let us consider the 
implications of the testing movement; I believe it will reveal 
the relative unimportance of the clash of words in the edu- 
cational battle, and it may indicate the substantial nature of 
our common educational objectives. 

At the outset let us look at what is, in a sense, the keystone 
of the modern testing program, the scholastic aptitude test. 
Twenty years ago men had little hesitation in speaking of 
intelligence tests and intelligence quotients. Intelligence was 
regarded as a native endowment, subject to development or 
determination through biological and psychological forces 
largely beyond our control, but in any event not subject to 
profound change by the academic process. We were dealing 
with an abstraction which represented some reality which we 
could measure, if not directly, at least by reflection, just as one 
‘‘sees’’ a proton by its path of condensate in a cloud chamber. 

It is of the first importance that we are now using more 
widely tests which are called “scholastic aptitude tests.” We 
hesitate to use a single number as an index of intelligence; 
such an oversimplified figure has been succeeded in practice 
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by a graph, or “profile.” There is lively skepticism as to the 
fixed or established nature of intellectual potentialities and 
as to the nature of the influences by which their growth, if 
any, is controlled. Whether apparent growth is determined 
more by heredity and other biological factors, or more by 
experience and learning is yet to be finally demonstrated. 
However, everyone recognizes that the scholastic aptitude 
test provides, in the main, an index of achievements and habits 
rather than a measure of native and fixed endowment. Both 
achievement and habit are governed by factors so multi- 
farious and so complex that they still defy full analysis. 
Nevertheless, among those factors the will to learn is exceed- 
ingly important, and the will appears not to be conditioned 
exclusively by biological or even by environmental influences, 
but by other forces both varied and powerful. If science is 
not in accord with the old theological doctrine of the free 
will, it is much closer to it than twenty years ago. 

The important conclusion is that experience with intelli- 
gence testing has served to restore our faith in the educability 
of the individual. If a boy’s intelligence were fixed and 
limited at (or almost from) birth, all the schools could do 
would be to train him. But if there is still plasticity and op- 
portunity for growth and change by academic measures, then 
one may speak with more confidence of that which is broader 
and more subtle than training, education itself. 

It is fair to say, therefore, that the war about “‘education”’ 
versus “‘training’’ was, in many respects, a sham battle. So 
generally is that now conceded that many former advocates 
of training are ardent proponents of general education. The 
change in front was hastened by the impact of technology 
which made men perhaps unduly conscious of the instability 
of employment for which specific training is available. It was 
facilitated by the overthrow of the presupposition of ‘peace 
in our time.”’ Under such circumstances the student as a 
person capable of repeated “re-education,” both as a worker 
and as a citizen in an age of transition, engages fresh atten- 
tion. But central in the change in front is the fact that the 
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very sort of test which was once supposed to have limited the 
function of the schools to training is now seen to have re- 
freshed our vision and expanded our opportunities for educa- 
tion. 

The current phrase “general education’”’ gives us a clue to 
a second sham battle in which many good men and true have 
been lost. Our grandfathers had no doubt whatever that a 
man could acquire a liberal education; he could gain an his- 
torical understanding of man’s experiences, some philosoph- 
ical grasp of their significance, and the power effectively to 
reason from those experiences in the solution of current prob- 
lems. He could acquire a “frame of reference” and relate 
fresh experience to that, both the experience of his daily 
occupation, and also the broader experiences of art and music, 
of appreciation as well as thought. Any man who had ac- 
quired that understanding, that frame of reference, was a 
man of culture. 

So firmly was this idea embedded in the American mind 
that it was long supposed to be the explanation of the skill 
with which amateurs in political philosophy framed the Con- 
stitution of the United States. That document was thought 
to be the product of reasoning from experience, both vicarious 
and personal, in an extraordinarly effective way. It was, in 
short, often used as an illustration of what cultivated men 
could achieve. Two major influences arose, however, and 
obscured for a time the whole concept of culture. First, Karl 
Marx gave currency to the theory of economic determinism; 
and many who did not accept all the Marxian consequences 
of that idea did accept an economic interpretation of history 
which denied man the spiritualized emotions and the idealistic 
drives with which culture and liberal education were asso- 
ciated. 

A second factor, even more extraordinary, helped over- 
throw the concept that man is only a little lower than the 
angels. His very success in revealing the secrets of nature 
produced a negative reaction. Men were not only amazed, 
but dismayed, at the multiplication of knowledge. Reasoning 
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falsely from the triumphs of specialism in science, they in- 
sisted that every man must be a specialist. The concepts of 
universality or universal validity involved in the liberal point 
of view seemed too bold. It was argued that anything like 
universality in point of view, such as one finds in Aristotle or 
Bacon, was now impossible. As knowledge multiplied, it 
seemed obvious that each man could know less in proportion 
to the total body of knowledge. By a logical leap of amazing 
proportions, that simple equation was misread into a demon- 
stration that man could not have a sense of proportion in 
what he could acquire and retain! We were offered many an 
educational argument unconsciously in praise of ignorance, 
implying that the more man knew, the less significance his 
knowledge could have! ‘This defeatist point of view with 
reference to man in the presence of his own achievements 
joined with economic determinism to ruin the moral position 
of a liberal culture. Many educationists turned defensively 
toward specific training upon the one hand and its highbrow 
twin, intellectual specialism, upon the other. 

The war upon the concept of culture, embodied in a liberal 
education, had its propaganda phase, the fury of which was 
no less than terrific. Liberal education was identified with 
the formal discipline, which was identified in turn with cer- 
tain curricular subjects, rather than with habits, methods, and 
perspective. If the Institute of Propaganda Analysis had 
existed in those days, it could have written a book about the 
name calling and the glittering generalities which would make 
its recent analysis of a radio orator seem rather tame by 
comparison. ‘“Transfer’’ likewise became involved in that 
propaganda, with, however, a reversed implication, and we 
were asked blandly, but with a malicious glint in the eye, what 
the knowledge of the date of the battle of Salamis had to do 
with growing potatoes, and how the declension of a Greek 
verb would pay the rent. Scientific studies were adduced to 
demonstrate that the subject matter contained no magic; 
other scientific studies proved that if there was magic it could 
not be transferred into any other field. It all ended in the 
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perfect demonstration that the subjects in question were with- 
out value in the modern world, that mastery of them did not 
tend to inculcate habits and attitudes valuable in other situa- 
tions. It is not surprising, to return to our illustration, that 
the framing of the Constitution received a new interpretation. 
It was no longer described as the vindication of culture, but 
as an illustration of somewhat slavish borrowing in an effort 
to protect speculative investments. 

As happens so often in war, the victorious combatants over- 
ran their objectives. While they were using science as an 
illustration that only specialism was possible, scientists en- 
gaged in startlingly brilliant achievements in generalization. 
Using no experimental methods, no calculating machines, none 
of the ordinary laboratory instruments, Einstein sought to 
combine and to correlate disparate data and superficially con- 
tradictory experiences into one correlated whole. It was an 
intimation, however imperfect his result, that the mind of 
man could grasp and deal with the larger and more conflicting 
elements of knowledge and experience. If a formula could 
express the unity of matter and motion, of time and space, 
it was conceivable that the mind of man could make a philo- 
sophic unity out of the sum of his apparently unrelated ex- 
periences. Einstein was only a symbol of the return of the 
theorist in science to a central position, and the theorist is 
simply one who by projecting the mind upon a maze reduces 
it from confusion to an orderly pattern. If the riddle of 
matter, motion, time, and space is reducible to order, the con- 
fusion of personal experience may well yield to a like effort. 

I may remark parenthetically that the sweep of events in 
Europe made economic determination look silly. Nothing 
could be more evident than that men are moved by many 
other kinds of motives. 

Thus both the assaults upon the reality of the synthesis 
involved in a liberal culture broke down. It is a favorable 
moment to inquire what are the inferences properly to be 
drawn from the testing program regarding this question of 
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synthesis. Superficially one might suppose that it reflected a 
want of belief in synthesis since no test is designed directly 
to measure that power of the mind or the quality of achieve- 
ment in that aspect of thought. On the other hand the entire 
program is built upon an assumption that knowledge cannot 
exist in the mind without synthesis—that something resem- 
bling philosophic unity is prerequisite to retention. The more 
full the knowledge, the more complete the availability of the 
factual possessions, the broader and more sound is the syn- 
thesis which holds them in significant relationship. As long 
as sixteen years ago this inference was summed up in a single 
sentence: ““We could not neglect the measurement of facts 
without neglecting the measurement of the very fabric of 
thinking.” The availability of data in the mind, that is to 
say, is the result of its logical arrangement in meaningful 
patterns. 

The large number of factual questions, predicated upon the 
inference just referred to, reveals another false basis for 
warfare. We have passed through a period when men railed 
at “mere” memory, at the cramming of factual material. We 
have been urged, instead, to insist upon more “understand- 
ing.”’ The acquisition of factual knowledge was acutely cari- 
catured in the Spoon River Anthology by the epitaph of Frank 
Drummer, who felt 


A high and urgent purpose in my soul 
Which drove me on trying to memorize 
The Encyclopedia Britannica! 


This particular aspect of the verbal warfare was not usually 
dealt with in such plain and homely phrases. Often the com- 
batants resorted to laying down smoke screens. Impene- 
trable phrases were set as barriers between the observer and 
his possible objective. Take, for example, “mnemonic resi- 
dues.”” This impresses me as the ultimate in the proliferation 
of polysyllabic vocables for the obfuscation of the obvious. 
Has discussion become so trivial that it must disguise its mean- 
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ing in order to appear significant? If in penetrating the fog of 
vowels and consonants we perceive the memory as the object 
of this description, the phrase is a bad one, for a mnemonic 
might perhaps fairly be described as an intrinsically meaning- 
less concatenation of symbolic references designed as an 
adventitious aid to the recall of something quite different. 
And a residue is what is left when some of the valuable part 
has been withdrawn. If we must talk about teaching and 
learning in terms that require translation, if it is all so eso- 
teric that only one skilled in the jargon can discuss it, then 
the discussion is hopeless. In these days of resentment at 
having to learn foreign languages, why devise a new one for 
our further confusion? The plain fact is that the assaults 
on the memory as a significant intellectual process had so little 
substance that only by a process of verbal inflation could they 
be promoted at all. Likewise the concept of understanding 
as a thing apart from facts and concepts was so shallow that 
it had to be concealed behind a screen of phrases lest its 
triviality be too obvious. 

The testing movement, I repeat, has shown the falsity of 
this warfare. While the battle raged about “mere” memory, 
the implications of asking two thousand questions of a single 
student in six hours are that memory is not “mere,” and con- 
sequently unimportant. Things remembered must be part of 
an intellectual construct which can well be described by the 
word “understanding” or by the adjective ‘‘coherent.’’ So 
firmly is this embedded in the testing program that it has 
been held, not a better exercise of the understanding, but a 
better test or measure of understanding than the usual hasty 
essay type of question. 

There are those who have sought to fight one of these 
desperate sham battles over that issue. They have seen in 
the new type of examination an enemy to good writing, to 
clear and forceful expression. It would be tragic indeed if 
anyone were deceived into so futile a warfare. As an exer- 
cise in understanding, as an enterprise in synthesis, as an effort 
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at individuality of expression, the essay finds no competition 
from the modern style of examination. One learns to write 
by writing, and students should write early and often. But 
that does not affect the validity of the short form examination 
as a measure of understanding. The analysis of the needs 
of the student rests upon measures as nearly objective as pos- 
sible, and upon judgments, unashamedly subjective, by com- 
petent and experienced teachers. Neither, without the other, 
can do the job. 

It is one of the most pathetic characteristcs of warfare 
that it is often inconsistent; its objectives in one area of con- 
flict do not accord at all with those in another. The western 
front represents one set of objectives, and the eastern a dif- 
ferent set, which are inconsistent. That analogy is sound 
when applied to the warfare among educators. On the west- 
ern front, the liberal redoubts were under attack because they 
insisted upon philosophic coherence. But over on the eastern 
front, the war was in favor of understanding as against facts. 
On the western front, it was insisted that you could not form 
a coherent pattern because there was too much to know; and 
on the eastern front, you were to understand it by knowing 
less and selecting among the possibilities of knowledge the 
useful ones. On the western front, you had to acquire 
information in a specialty because no one could know it all; 
on the eastern front, the less you knew the more clearly you 
would understand it. 

This difference between the various educational fronts 
was simply another illustration of how men at war are per- 
sistently illogical. Of course the disputants never went so 
far as to deny that students had to have facts. Instead facts 
were classified; there were “useless” facts and “useful” facts. 
The useless facts were those which were unknown to the per- 
son making the argument, and the useful facts were those with 
which he was familiar, or thought he ought to be. Sometimes 
they were classified on a different basis—not quite so egocen- 
tric—namely, those which the student would “use” again and 
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those which he would not use again. What was meant by 
using them was never clear, and how one could deal with a 
whole class, with all the differences in tastes, aptitudes, in- 
terests, and experiences, and peering into the future by astro- 
logical means, tell which facts would be useful to all of them, 
or any of them, was never made clear. 

Negatively, it was held to be obvious, for example, that since 
world peace had become an established fact, it was useless to 
learn about battles and wars which had gone out with kings 
and tyrants, and which the triumphant democratic principle 
would banish from the earth. Had we not “outlawed” war? 
Napoleon was dead. He represented a peculiar interlude in 
history which would never have any counterpart in modern 
experience. He represented an individualistic manifestation 
rather than a social movement, and for that and many other 
reasons, knowledge about him obviously belonged in the use- 
less category. What applied to him naturally applied in double 
form to such antiques as Charlemagne, or Caesar, or Alexan- 
der. But the outlawry of war has had the fate of prohibition, 
and the temperance movement in the use of arms has failed. 
Napoleon walks again, his swift campaigns startle Europe 
with their brilliance and terror, and England stands once more 
with her back to the wall. 

In the light of unreal arguments about useful and useless 
facts, it is significant that questions on the broad cultural ex- 
perience of the race are so important an element in the testing 
program. Their use reflects the re-emergence of the word 
“culture” after twenty-five years on the black list. Giving this 
type of test reveals the fact, which is the central thesis of 
this argument, that while the sham battle raged, even those 
who expressed the greatest skepticism about the educative 
process, nonetheless belied their words by their activities. 
Their use of tests showed an unspoken faith in the possibility 
of significances that are not obvious. All the facts of human 
experience are useful, there being no predictability as to which 
will be utilized by any individual mind. Each mind inevitably 
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must make its own selection, and the use made of the fact 
depends upon that choice. 

A comprehensive testing program does not play favorites 
in reflecting our objectives; it shows the weak spots as well as 
those which are strong. It shows, for example, that this re- 
vived faith in culture is not yet complete. Culture tends to 
appear as a definite content—as an awareness of certain facts 
without direct vocational utility, which may therefore be pre- 
sumed to be incorporated into one’s body of knowledge as 
instruments of certain values. Unhappily it is not clear that 
culture is not a quantity but an attitude, a method, or a way 
of perceiving reality. At its best, culture represents a way of 
refining standards of value—and that no test can measure. 

Another sham battle has been fought regarding language. 
It is a paradox more puzzling than any other so far, that as 
long as the United States was really isolated, with a minimum 
of international trade, no cables, no telephones, no radios, no 
steamships, no airplanes, no motion pictures, and relatively 
few immigrants who did not speak English, every well-educated 
man was trained in the foreign languages. Now, with twenty 
million daily radio listeners, with ten million more in daily 
contact with foreign languages, with all the modes of present- 
day contact, many disputants insist that foreign languages are 
not important. They are taught grudgingly, therefore poorly, 
and then it is declared that the results do not justify them. 
The cold fact, stripped of all wishful thinking, is that the 
‘common man”’ has more direct contact with foreign languages 
today than ever before in history. 

Verbal aptitude tests, artificial language tests, and other 
aspects of the testing program indicate that there is still a 
basic realization that language is the most useful means of 
communication between humans, and that the mastery of more 
languages than our own is an essential of life in a world where 
other languages crowd us more closely than ever before. We 
have heard it argued that “naturally people in Europe should 
know more languages because so many linguistic stocks are 


102 The Educational Record Supplement for January 1940 


crowded so closely together.” Yet the population of those 
nations tends to be relatively so immobile that they actually 
come into contact with foreign languages less than do Ameri- 
cans, who not only travel more freely than others, but who 
own and use radios more widely and more actively than any 
other people in the world. 

In this list of evidences that beneath the roar of battle are 
some important concealed realities, one word should be said 
about the whipping boy of modern education, mathematics. 
It is an extraordinary fact in the history of education, that the 
center of mathematical knowledge and research should have 
shifted to the United States at the very moment when, in edu- 
cational discussion, mathematics has its worst press. Most of 
mathematics has been denounced as useless—quadratic equa- 
tions as merely instruments of intellectual torture, geometry 
as an irrelevant mode of abuse, and calculus as simply ridicu- 
lous except for the specialist. A vote taken among the high 
school principals in the region of the North Central Associa- 
tion a few years ago showed that 80 per cent of them would 
drop algebra and geometry but for the tyrannous insistence 
of the colleges upon this useless and irrelevant matter. It 
is saddled upon the schools by those who labor under ‘the 
shackles of traditionalism,” who are “blind to the new day” 
in which we are living, and who would protect their “vested 
interests at the sacrifice of the youth of America.” I cannot 
give even a very good imitation of their fervor, for I do not 
share it. 

The point I would stress is that one aspect of the testing 
program is predicated upon the assumption that one of the 
best tests of reasoning power is mathematics. Certainly no 
rounded program of testing omits mathematics. It may come 
as a shock to some to realize the implications of that pro- 
cedure. But it should not, for reasoning in mathematical terms 
is fundamentally removed from all questions of personal in- 
terest; it is free of all economic determinisms; it escapes all 
the daily issues which tend to confuse; and it is a process where 
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Opinion as opposed to precision can play a very slight part. 
As long as the testing program reveals this presupposition 
regarding mathematics, it is much more significant than any 
Gallup poll among the high school principals, who, like all the 
rest of us, gladly shift responsibility for what is sometimes 
unpalatable. 

The most important of all the implications of the program 
of modern testing I have kept for the last. The testing move- 
ment returns our attention to the student as an individual. 
More than any other factor, the testing program is responsi- 
ble for the new emphasis upon individuality; it is both the 
best measure of that quality and the best guide for its develop- 
ment. Individual differences have long been discussed, but we 
have been confronted with the irrational situation of discuss- 
ing them at a time when the curriculum, almost by definition 
hostile to individual differences, has been the primary field of 
faculty action. 

The testing program has demonstrated the wisdom of the 
penetrating remark of one of the leaders of the testing move- 
ment that what leaves the mouth of the professor is not neces- 
sarily what enters the mind of the student. The impact of the 
curriculum on different minds has been shown to be so various 
that the authority of the curriculum as the basis of education 
has been destroyed. The growth of the student’s mind, the 
breadth of his information, and the significance of his insights 
are the real elements. Instead of trying to fit plastic youth 
into a hard curricular mold, the curriculum itself should be 
fluid in order to fill to overflowing intellectual vessels of vari- 
ous capacities and forms. 

Such a result cannot be achieved under the course credit 
procedure, which was designed for the convenience of the 
registrar, rather than for the student. That system was based 
upon a false analogy from industrial production and is not 
an historical part of the college procedure. In this respect 
the old college catalogs are deceptive to the modern eye 
and the modern mind. To a casual reader they look as though 
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course credits had always existed. There were courses, indeed ; 
but they were not the standardized, interchangeable academic 
parts of today. They represented an orderly progression of 
ideas and dealt consecutively with them. Prerequisites related 
to mastery rather than prior credits. Many a man who gave 
evidence of having achieved substantive mastery was excused 
formal performance. That was much more common even 
thirty years ago than it has been in the last decade. The pro- 
portion of persons who graduated in three years was probably 
larger a century ago than those who receive degrees in less 
than four years under the Chicago plan. The testing program 
retires the registrar in favor of the student. Its assumption 
is that it is essential to afford the student opportunity from 
time to time to review his own status and to have the con- 
sciousness of achievement, based upon the considered criticism 
and judgment of his teachers and the objective evidence of 
his examinations. 

Once that point of view is adopted, it puts an end to the 
sham battles over summer “‘credits.”” I have sat through many 
discussions of credit for work done in the summer and can 
report after twenty-five years of observation that there is a 
deep-seated suspicion of anything learned in hot weather. 
Somehow we have come to assume that the summer is neces- 
sarily a period of intellectual stagnation, and unless our own 
institution gets the fees for it, anything a student does in the 
summer time must not appear in the great book of remem- 
brance in the registrar’s safe. 

In the abstract we all recognize that travel is broadening, 
but we have done our best to conceal that fact by withhola- 
ing credit from anything learned while in a mobile condition. 
Perhaps that is why we speak of our institutions as “‘seats”’ of 
learning. For some strange reason the situs of the instruction 
has been regarded as more significant than the circumstance 
that the student has learned. The testing program shows that 
the mind may function even in a region of relatively high 
humidity and that things learned outside the gates—even far- 
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ther from the gates than the tutoring schools—may nonethe- 
less enter into the structure of the mind. An awareness on the 
part of the student of these facts takes away the premium 
upon idleness and intellectual sterility. 

There is an element of irony in the fact that the newest 
revelation of the difference between intellectual equipment and 
the college record of it should have come through the desire 
of graduate schools to know what the students brought with 
them. It might have been expected that undergraduate insti- 
tutions would be first in seeking to give the student a more 
realistic picture of his own achievements. The Graduate 
Record Examination was given first in 1937 to the entering 
graduate students at Harvard, Yale, Princeton, and Columbia. 
It has been given in each succeeding year, being modified with 
experience. The result has been to shed new light upon the 
individual, showing how inadequate are the college registrar’s 
records in mirroring intellectual progress. 

As it became clear that the registrar’s records by themselves 
were not a satisfactory description of the attainments of be- 
ginning graduate students, the conclusion was inescapable that 
the test belonged in the college rather than in the graduate 
school. Consequently it was given to seniors in a few institu- 
tions, and the results of that experiment were so extraordinary 
that there was no conceivable excuse for not making it avail- 
able to underclassmen. They were ready to take the test on 
their own initiative, without scholastic credit, with no reward 
except a clearer knowledge of their own intellectual status. 
This definitely revealed what had been denied both in word 
and in practice; namely, that the student is vastly more inter- 
ested in his progress than is the registrar. It supplied another 
illustration of the fact that the whole system of unit courses 
and unit credits is bankrupt and is simply being operated in 
receivership pending a solvent reorganization. That reorgani- 
zation may find its underlying principle in the application of 
uniform, complete, repeated, and revealing inventories of the 
student’s knowledge. Already the test has furnished many 
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useful aids to the organization of the student’s work—but 
they fall outside the scope of this discussion. 

I do not contend the testing program has made an end of 
the educational war; the sham battles will go on, and we shall 
be diverted and confused by the energies expended in endless 
strife. Nevertheless, it is heartening to realize that beneath 
the slaughter of terms there is a solid, substantial set of objec- 
tives at which most of us are aiming. Important as the testing 
program is in many other ways, I suggest that it is exceedingly 
important in one of the areas in which its friends have made 


few claims; it provides an indication that an effective educa- 
tional policy does exist. 





Recent Trends in the Comprehensive 
Examination in English 
By EDWARD 5S. NOYES 


HIS paper must begin with a confession. It has been 

written, not by an expert in the techniques of examin- 

ing, but by a mere teacher of English. I am, alas, so 
ignorant of statistical methods that I cannot even talk the 
language of the science of measurement. Each year I get some 
kind person to explain, in words of one syllable, the meaning 
of a few of its simpler terms, such as sigma, but in an appal- 
lingly brief time I manage to get sigma confused with medians, 
norms, and correlation coeffiicients—whatever they may be. 
Thus I speak not as one having authority, but as one of the 
scribes—as the oldest living Reader of the Comprehensive ex- 
amination who is still in harness, and as one who has, through 
that experience, participated in changes of whose full signifi- 
cance he has often been unaware. 

During the past six years changes have taken place, chiefly 
in the construction and the grading of the Comprehensive 
English examination, which have brought about a considerable 
increase in the reliability with which that important paper can 
be read. This increase in reliability of reading, as I under- 
stand it, means that two Readers independently grading the 
same answer were much more likely to agree on the mark to 
be assigned to it last June than they would have been ten or 
fifteen years ago. Even so utter a layman as I am can perceive 
that such a change is highly desirable, and I am told on good 
authority that it has actually occurred. To use statistics for 
the first, and, I trust, for the last time in this paper: the co- 
efficient of reliability of reading has climbed from about .50 
in 1933 to .84 in 1937 and .88 in June 1939, its all-time high. 
The index is computed from two independent sets of reading 
of about one thousand examination books. How much higher 
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the index may go remains to be seen. Its present state is such, 
however, that the Comprehensive examination no longer lies 
open to the charge so often leveled against subjectively scored 
tests of this kind—that their advantages are nullified by sheer 
unreliability of reading. My purpose this morning is to ex- 
plain, as briefly and as clearly as I can, the principal changes 
in the preparation and grading of this examination which seem 
to be responsible for producing such gratifying results. After- 
wards, I shall be glad to answer any questions which may 
occur to you, just so long as they do not involve statistical 
details. 

These changes have been gradual, not sudden or startling, 
nor have they been due to any one person. Some suggestions 
have come from Professor Brigham of Princeton, Research 
Associate of the College Board, some from Mr. Stalnaker, 
the Board’s Consultant Examiner. Others have emanated 
from experienced Readers like Professor Crawford of Yale, 
Professor Sale of Cornell, Professor Joyce of Dartmouth, or 
Mr. Zahner of Groton, to mention a few of many possible 
names. A hundred Readers annually, besides several commit- 
tees of Examiners, have worked on them. In other words, 
the development of the Comprehensive English paper has 
come from the work, not of any single person, but of a large 
group of teachers of English in schools and colleges who be- 
lieve thoroughly in its aims and who have secured extremely 
valuable technical aid. 

The changes of which I speak fall naturally under three 
heads; innovations in the preparation of the examination, in 
the training of the Readers, and in the grading of answer 
books. I shall take them up in that order. I should begin, 
however, by emphasizing as strongly as I can the fact that 
there has been no change whatever in the fundamental pur- 
pose or methods of the examination. With whatever minor 
alterations, it still follows the principles set forth at its begin- 
ning and reasserted in the Report of the Commission on 
English in 1929: it is an examination “designed to test the 
student’s power to think through and to organize the material 
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contained in the books he has read, to read intelligently poetry 
and prose at sight, and to express his ideas in an effective 
way.” Such aims, it seems to me, can be attained only by an 
examination of the subjective, or essay type, the accurate 
scoring of which has always presented serious problems. The 
cause of our difficulties was never more vividly expressed than 
by a student who wrote, on his Comprehensive test some years 
ago: “It is true that no two people are alike in their finger- 
prints or in the convulsions of their minds.” And Readers, 
even of the Comprehensive paper, are, after all, people. 
Now, as in the past, preparation of the Comprehensive 
examination is entrusted to a committee of Examiners who 
are teachers of English in school or college. Some Examiners 
also serve as Readers, so that there may be full cooperation 
between those who construct and those who grade the test. 
The problem of the Examiners is partly that of definition. The 
field of English, I need hardly remind you, is an exceedingly 
broad one, including everything from spelling to creative writ- 
ing on one side, and from the simplest forms of reading to 
literary criticism on another. No three-hour examination, 
however comprehensive its name, can hope to cover more 
than very limited portions of the whole field. During the past 
few years the Examiners have, I think, been making a con- 
scious effort to define as accurately as possible the particular 
section of the field which is to be covered by any given ques- 
tion on the paper. For instance, one question on the Compre- 
hensive examination has always required candidates to write 
a theme. It used to suggest from eight to a dozen possible 
topics, on the theory that some one suggestion would prove 
to be an inspiration to one type of candidate, whereas another 
type might be able to write better on a different topic. Such 
a theory implies, however, that examination topics can sum- 
mon inspiration, as Glendower could summon spirits from 
the vasty deep, and that a student should be judged only by the 
best writing of which he was capable. The present Examiners 
are more or less committed to a different theory: they held 
that the paper should test a student’s normal writing habits, 
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as far as possible, and should not be expected to provide 
inspiration. They believe that all candidates should be asked 
to run the same race; and that, therefore, a single essay topic 
based on reading or other experiences common to all candi- 
dates is better than a multiplicity of subjects which are some- 
times confusing to the students and always a thorn in the flesh 
of the Readers. 

The most important single change in the preparation of 
the examination, however, is the current practice of pretesting 
the questions. For the past three years we have been able to 
try out our ideas on groups of students comparable in every- 
thing but numbers to the June examinees. It has been possible 
to keep the work secret by giving to any one group, as part 
of some regular program, only a small portion of the whole 
examination. For any examination the advantages of pre- 
testing are great; for such a paper as the Comprehensive, 
they are invaluable. Examiners, for instance, may work for 
hours on the wording of a single question, in an effort to make 
it convey but one meaning, only to have the Readers the 
following June discover that the ingenuity of the candidates 
had been grossly underestimated, and had evolved a whole 
new series of meanings undreamed of in the naive philosophy 
of Examiners. A few years ago the phrase ‘‘a master of his 
craft,” applied to a well-known author, appeared on the Com- 
prehensive examination. It seemed innocent enough, but the 
Readers found several dozen students who believed it to mean 
that the said author, Samuel Johnson, was an expert yachts- 
man. I do not believe that we shall ever escape such mis- 
apprehensions entirely, but pretesting gives us an opportunity 
to find out how our questions are most likely to be misunder- 
stood and to modify them accordingly. It is of even greater 
value in the selection of material. At least one section of 
the Comprehensive has traditionally sought to test the stu- 
dent’s ability to read at sight by asking him questions about 
passages of prose or poetry. Examiners are forever hunt- 
ing for passages especially suitable for this part of the paper, 
but they have always had to guess just which of all the pas- 
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sages collected after long search would produce the best re- 
sults. It is now possible to secure documentary evidence that 
Passage A is better for our purposes than Passage B. Or 
take, as a final example, the problem of the length of time 
to be allotted to a given question. How long will it take the 
average candidate to write his answer? Although the group 
pretested is far smaller than the seven thousand who write 
the full examination in June, it is large enough to give us a 
rough idea of the length of each question and so to avoid 
the two extremes of a test too long or too short. This inno- 
vation, therefore, has already proved its worth in many dif- 
ferent ways. 

A second series of alterations has been made in the prepara- 
tion for actual reading in June. These changes have con- 
siderably increased the time spent in the training of Readers, 
but have made up for that apparent loss by increasing the 
speed as well as the accuracy of the reading when once it gets 
under way. It is difficult to explain them without contrasting 
them with the older methods with which some of you may 
be familiar. 

Until about 1935, each Reader corrected all the answers 
written by a single student. He would take four books, for 
instance, mark them independently, keeping his scores on a 
tally sheet, and then trade them for four other books graded 
by another Reader with whom he had been paired for the 
day. When both Readers had finished with all eight books, 
they conferred about the grades to be assigned. When they 
agreed, all was well; when they did not agree, they sooner 
or later referred the dispute to some other Reader. Occa- 
sionally a book might pass through five or six Readers’ hands 
before its grade was settled upon. This method had serious 
drawbacks: a book ran some risk of being rated not on its 
real merits but according to the belief, sometimes emotionally 
tinged, of the Reader who had the more aggressive and 
dominant personality. Moreover, the time spent on confer- 
ences seriously increased the cost of the examination. Hence 
the system has been abandoned. 
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For some years now, the Readers have been divided into 
Groups, each of which reads only one section of the exami- 
nation: they have become specialists, rather than Jacks of all 
trades. The Groups are subdivided into Tables of six or 
seven Readers, each with a Leader responsible for the work 
at his or her Table. Such an organization makes possible a 
carefully planned and supervised training session, the object 
of which is to help Groups of thirty or forty Readers— 
teachers of English who come from different schools and col- 
leges all over the country—to arrive at a common under- 
standing of the problems of their particular question and a 
common method of attack on these problems. I shall try to 
describe this preparatory work because it is vital to the suc- 
cess of the examination. 

While the students are still writing their answers, on some 
Monday morning in June, the Chief Reader and the Table 
Leaders meet to plan the reading. Their task is to study 
the answer books as rapidly as they become available, and 
from that study to draw up instructions for each of the 
Groups of Readers, as well as to select from the books them- 
selves sample answers which can be mimeographed and on 
which the Readers can practice the art of grading. This task 
is now made somewhat easier by the work of pretesting, 
which has already revealed to some members of this prelimi- 
nary committee the nature of the chief problems and indicated 
ways by which they may be met. Nevertheless it is still very 
difficult; constant alterations have to be made in the instruc- 
tions to Readers, as new and different answers turn up which 
simply will not fit into categories apparently firmly estab- 
lished. Sample answers have to be most carefully selected, 
mimeographed, proof-read, and then tested again to see 
whether or not, in the light of somewhat later experience, 
they still exemplify the grades they were intended to illustrate. 
As some of you may know, the same answer presents in print 
an appearance astonishingly different from its original appear- 
ance in a student’s hieroglyphics. For this part of the prepa- 
ration, three full days of the most intensive kind of labor by 
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a small committee of experienced Readers are necessary. On 
Thursday, the main body of Readers arrives, and the second 
phase of preparation commences. 

Last June, for the first time, each Reader was asked to 
begin work by writing, in the same time as had been allotted 
to the candidates, that part of the examination which he was 
later to correct. The request caused some consternation 
among the Readers, but when they learned that their answers 
were not to be graded, or even collected, they submitted grace- 
fully to the operation. Its purpose was to familiarize them 
thoroughly with the questions for which they were to be 
responsible and to enable them to understand the candidates’ 
problems with a keener insight than could come from merely 
reading answers. 

After this process, Group Leaders distributed the direc- 
tions to Readers, as well as a mimeographed set of sample 
answers illustrating different ranges of marks. Those an- 
swers had been tentatively graded by the preliminary commit- 
tee of Group and Table Leaders, who now had to explain to 
the satisfaction of their colleagues why each particular grade 
had been assigned. At this point in the process, every Reader 
is entitled to criticize the work of the committee, and most 
Readers do—not always favorably. The standards by which 
the examination is to be marked are tentatively outlined by 
the committee, but they are always modified to some extent 
by the judgment of the whole body of Readers. When, after 
much discussion, the grades for the first set of sample answers 
have been agreed upon, that set becomes a useful point of 
reference, and the Readers are given a second set for practice 
grading. A census of the marks independently given to this 
second set of samples usually reveals that in a Group of some 
thirty Readers, about twenty are in virtual agreement, the 
other ten being either higher or lower than the rest. Discus- 
sion and analysis of the answers follows, until some of the 
points in dispute have been settled. Then another set of 
sample answers is used in the same fashion, and the pro- 
cedure is repeated until the Group and Table Leaders are 
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certain that a reasonable degree of standardization has been 
achieved. Perhaps I can illustrate the effectiveness of such 
training by showing how one of the questions on last June’s 
paper was treated. I choose a portion of Question 3—on 
interpretation of sight passages—because it is short enough 
to use here. 

Question 3 began with a definition: ‘“‘A metaphor is a trans- 
fer of meanings, one thing or act being named or implied 
when another is meant. It is the commonest and most ser- 
viceable figure in language.’’ Then followed these directions 
to candidates: “There is at least one metaphor in each of the 
following passages. Indicate the metaphors in each passage 
and translate them in such a way as to show your under- 
standing of the author’s use of them. Allow about 25 minutes 
for this question. The model below is intended to suggest the 
kind of answer expected.” 

For the sake of brevity, I omit the model. The first pas- 
sage was Mr. Wodehouse’s delightful remark: “Poverty is 
the banana skin on the doorstep of romance.” 

After studying many answers to this question, the prelimi- 
nary committee set forth directions for their Readers as fol- 
lows: Answers were to be marked on a maximum of five points. 
Readers were to give one point for an answer which showed 
adequate comprehension of the passage as a whole. This 
award was in line with the basic purpose of the question. —Two 
other points were to be given for fulfilment of the instruc- 
tions: one for explicit indication of the principal metaphors, 
in this case, banana skin and doorstep, and the other for ade- 
quate translation of these terms. A fourth point was a kind 
of bonus—given when an answer revealed more than a 
merely adequate understanding of the passage, as, for example, 
when a student recognized Wodehouse’s humorous purpose. 
The fifth point was to be given for composition—to all an- 
swers not incoherent or marred by serious grammatical errors. 
All these standards for the grading were based on the instruc- 
tions to the students, as stated either in the question itself or 
at the beginning of the examination, which warned them that 
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every question was designed to test their ability to read and 
write. I quote Mr. Wodehouse again, and then present two 
actual answers: “Poverty is the banana skin on the doorstep 
of romance.” 

“In this sentence Wodehouse means the banana skin to be 
an aid rather than a hindrance to romance. By this Wode- 
house shows that a person does not stop to think about falling 
in love merely because of poverty.” I think I can see Jeeves 
raising his eyebrows at that answer. Analyzing it according 
to the standards I have just quoted, we find that the candi- 
date loses the first point by failing to comprehend the meaning 
of the passage. He loses the second by indicating only one of 
the metaphors, and the third by mistranslating that one. It 
is impossible to award him the fourth point, for more than 
a merely adequate comprehension, since his understanding is 
not even adequate. Yet his answer is reasonably grammati- 
cal; it has no misspellings and the sentences are properly 
punctuated. Hence his mark is one point: one out of five. 
As you remember, there were four other passages in this 
question on which he had a chance to redeem himself. 

Here is another answer: “Wodehouse is humorously say- 
ing that poverty is the danger that romance faces at its begin- 
ning.” This student did not bother very much about his in- 
structions, but clearly understood the purport of the passage. 
So, he received one point for comprehension, lost the second 
because he failed to indicate the metaphors explicitly, as he 
had been told to do, but won points for translating both meta- 
phors, for recognizing the humorous purpose, and for com- 
position, his total being four out of the possible five. 

Now without the elaborate training period it would have 
been possible for any teacher of English to realize that the 
second answer was better than the first. Without the standards 
established by the directions to Readers, two teachers might 
well have eventually agreed approximately on the grades to be 
given these answers. But the training and the standard direc- 
tion, together, actually enabled thirty-five Readers, working 
independently, to agree promptly and precisely on grades, not 
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only for these fairly easy samples, but also for many which 
presented problems much more complex. When a census of 
the grades given to a full set of sample answers by a group 
of thirty-five Readers, working independently, shows a high 
degree of uniformity, the training period has done its work 
and the actual reading of books can begin. 

Every June for the past six or seven years, the Readers 
have undergone some such training process as I have de- 
scribed. Modifications and experiments are constantly being 
tried; the period of training has steadily been lengthened. 
I suspect, indeed, that last year some Readers began to fear 
that they would never be allowed to grade blue books, but 
would spend the whole summer practicing on sample answers. 
Still they cooperated most heartily, and the results seem to 
justify the process. 

New devices, for maintaining the standards once gained, 
have also appeared. ‘Two years ago it was suggested that it 
would be valuable to have each Group begin, every morning, 
by grading a single sample answer. A census of the grades 
would reveal whether or not the Groups continued to hold 
together, under the stress of reading. Readers who for one 
reason or another were likely to get out of line would be 
discovered, and could be shown wherein they erred. This 
procedure has been found very useful, although it is no longer 
necessary to continue it throughout the period of the reading. 
As soon as other improvements are discovered, we shall try 
to put them into effect. I do not present this process as being 
perfect, but as a steady, gradual development. 

The third and final series of changes has come about in the 
system of marking the examination. Until 1934, each ques- 
tion was given a definite value by the Readers, and every 
answer to that question was then marked on the scale of 100. 
Thus a “barely passing”’ answer would be rated at 60 per cent 
of the maximum value of the question, whatever that maxi- 
mum might be. Incidentally, this called for more arithmetical 
skill than some of us ever possessed! ‘Barely passing’ was 
defined as “showing minimum ability to carry successfully col- 
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lege work in English.” This system had the advantage of 
being one with which most teachers were, in theory, familiar. 
It could be used with a reasonably small and homogenous 
body of Readers with a common background and training. 
For a hundred or more Readers, drawn from boys’ schools, 
girls’ schools, public schools, private schools, men’s colleges, 
women’s colleges, and coeducational institutions, each with 
its own standards of “passing,” the system was hazardous. 
It has, therefore, been abandoned in favor of a method which 
seeks a firmer foundation than the notion of passing or failing. 
After all, the job of the Readers is to arrange the answer 
books in the order of their excellence; it is for the college to 
decide just how far up or down the line it cares to go in con- 
sidering a grade satisfactory. 

Today, therefore, each question is graded on a series of 
points suggested by the terms and the purpose of the ques- 
tion itself, and determined by a careful analysis of the answers 
written by the students. No Reader has to worry as to 
whether or not he is keeping some candidate out of college; 
he will deal, at most, with only a third of any answer book, 
and he will grade it according to standards which he himself 
has helped to define and establish. He is trained to analyze 
each answer to discover the presence or absence of certain 
qualities, or elements, as I have already illustrated by analyz- 
ing interpretations of the passage from Wodehouse. The 
Reader can, I am sure, approach the problem of marking 
with greater confidence and more objectively than was pos- 
sible for any but the most experienced Readers under the 
old system. 

The new analytical method of grading has proved espe- 
cially valuable in dealing with the essay question. As all 
English teachers know, marking themes is ticklish business. 
Many elements have to be considered; the student’s organi- 
zation of his material; technical points of composition such 
as spelling and punctuation; sentence and paragraph struc- 
ture; the right or wrong use of words, and so forth. It has 
always been difficult for Readers to agree with any precise- 
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ness on the grade to be assigned to a theme, simply because 
each Reader may have different notions of the relative value 
of the elements I have just enumerated. One Reader may 
consider bad spelling the deadliest of sins; another will not par- 
ticularly mind misspelling but abhors the comma fault; a third, 
impatient with such minor details, stresses much more heavily 
the plan or organization of the essay. Our present system, 
by giving definite and predetermined values to each of these 
elements, makes it possible for all the Readers to use approxi- 
mately the same yardstick, and hence has contributed im- 
mensely to the increase in the reliability of reading. Last 
June, for example, the maximum grade for the essay ques- 
tion was eleven points. Four were awarded according to 
accuracy in writing, or technique of composition. Three were 
given for organization and paragraph structure, and four for 
varying knowledge and skill in the use of books required by 
the topic. Whether or not this particular allocation of points 
to the various elements of an essay is ideally correct, is un- 
doubtedly debatable. More important is the fact that all 
Readers used the same allocation. 

One result of this system has been an increase in the range 
of grades used. In the old days, the vast bulk of themes 
tended annually to fall into the grades of C or D, with very 
few in either the lowest or the highest brackets. Last June 
the whole range of the scale was used, from zero to eleven. If 
we can assume that the elements of the theme for which points 
are awarded are valid, the spread of grades means, I take it, 
that Readers are now differentiating more accurately among 
the varying abilities of the students. This, too, is an increase 
in the reliability of reading, in a sense somewhat different 
from the earlier use of that phrase. 

Any description of this new method of reading, I suspect, 
is likely to make it appear exceedingly mechanical, as though 
a clerk with a blueprint could check off points almost auto- 
matically. It is true that we are asking Readers to make their 
judgments within areas much more carefully defined than in 
the past. But it is also true that there is still a demand for 
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trained intelligence and special knowledge of the subject; that 
even in the most limited area there is still room for disagree- 
ments and a need for thoughtful decisions. The Readers 
themselves are unanimous in their preference for the new 
methods, but that they have not become robots or mere ma- 
chines would be instantly evident to even the most casual 
visitor to the work room in Barnard Hall. 

I have tried to describe the three main lines on which the 
development of the Comprehensive examination has been tak- 
ing place. I fear lest I have too often pointed with pride to 
the more recent innovations and may have given the impres- 
sion that, not so long ago, in the consulship of Plancus, the 
examination was poorly constructed and badly marked. 
Nothing is farther from my purpose. All that we have done 
has been to push forward experiments begun by our predeces- 
sors and to modify our methods in the light of their experi- 
ence. We shall try to keep the examination itself from be- 
coming stereotyped in form, using any types of questions which 
prove to be valuable, within the limits set by the purpose of 
the paper. The Comprehensive examination has always 
exerted a very considerable influence on the teaching of Eng- 
lish in colleges and secondary schools, both by the kind of 
questions it asks and by the standards of grading in which 
so many teachers have been trained. Our effort, as Exami- 
ners and Readers, must still be to improve the effectiveness 
of the paper as a measuring instrument without ever losing 
sight of its basic aim: to test the student’s knowledge of books 
he has read, his power to read intelligently poetry and prose 
at sight, and his power to express his ideas accurately and 
effectively. 












Can We Influence Mental Growth: A 
Critique of Recent Experiments 
By FLORENCE L. GOODENOUGH 


HAT individuals differ in such mental characteristics as 

ability to learn, to reason effectively, to solve theoretical 

and practical problems, or to pass the various items 
making up an intelligence test is a fact that has long been 
recognized both by the scientist and by the typical ‘“‘man-on- 
the-street.’” Moreover, that such differences in mental capacity 
cannot be wholly ascribed to obvious factors in the conditions 
under which children are reared seems evident from certain 
facts of everyday experience. The resemblance of siblings in 
mental traits appears to be little if at all closer than is their 
resemblance in eye-color, hair-color, or other physical traits 
that are not commonly thought to be greatly affected by post- 
natal factors. All of us have known families that include chil- 
dren whose mental abilities range all the way from near-genius 
to extreme backwardness with no known external factors to 
account for the difference. Indeed, in many such cases, it is 
the retarded rather than the gifted child upon whom most 
of the parents’ care and attention have been lavished in the 
hope that some means might be found by which his mentality 
could be brought nearer to that of his more favorably endowed 
brothers and sisters. Physically identical twins have repeat- 
edly been shown to resemble each other far more closely in 
mental traits than do like-sexed fraternal twins reared in the 
same household. Continued attendance at the same school or 
residence in the same institution does not appear to reduce 
the intellectual variance among individuals to any appreciable 
degree. 

Tue IQ Nor Atways “Constant” 


The consistency of these relationships should not, however, 
lead us to conclude that the mental status of an individual is in 
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all cases an invariant and predictable thing. On the contrary, 
most of us have known some instances, at least, in which chil- 
dren who originally seemed backward have later moved into 
the front ranks of their classes at school, as well as others 
whose early promise gave way to mediocrity or dullness. The 
fact that these cases are exceptional rather than the rule should 
not blind us to the fact that they sometimes occur. Although 
extreme adherents to the doctrine of the “constancy of the 
IQ” have in the past been inclined to ascribe all such “‘changes”’ 
to inaccuracy of observation or errors of measurement rather 
than to true shifts in the rate of mental growth, more recent 
studies based upon repeated measurements of the same chil- 
dren over an extended number of years renders this hypothesis 
hardly tenable as an explanation for all cases. At the Institute 
of Child Welfare of the University of Minnesota, for instance, 
the mental development of several hundred children has been 
followed by means of annual testing over periods ranging from 
two to fifteen years. More than a hundred cases have been 
studied for ten years or longer. While the great majority 
of these children have shown a very regular and even type of 
growth curve with intelligence quotients showing only the ex- 
pected minor fluctuations from age to age, this is not true of 
all. Examination of the records of a few children shows a 
continued acceleration in rate of mental growth. Others show 
an equally steady downward trend. 

Here, for example, are the test results for two children who 
have lived in adjoining houses all their lives and have attended 
the same school. On her initial test at the age of two years the 
first child’s IQ on the Minnesota Preschool test was 98; a level 
that agreed very closely with the estimates of her parents, 
both of whom are trained psychologists and who were unani- 
mous in thinking this child much less advanced than was her 
older sister at the same age. A year later, however, the IQ 
had risen to 115. Annual testings thereafter, at first with the 
Minnesota, then with the Stanford, yielded the following re- 
sults: 124, 118, 112, 119, and 123, the last on the Stanford 
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at the age of five and a half. The next test was given at the 
age of seven and a half, at which time her Stanford-Binet IQ 
was 126, which is very slightly higher than any previously 
earned. The following year it had jumped to 133, the next 
year to 150. On the three succeeding years the results were: 
143, 147 and 151; the last being earned on the 1937 Revision 
of the Stanford at the age of twelve and a half. Her school 
records have paralleled the changes in test standing since her 
work in the primary grades was good but not outstanding, 
while in the upper grades and now in her first years of high 
school she is making one of the best records in a class of very 
superior students. Without any known external causes, this 
child’s IQ has risen in the course of a ten-year period from 98 
to 151, a change that is paralleled by her school record and 
by the observations of her parents. She did not attend nursery 
school. 

The second child was first tested by us at the age of six. 
Her IQ at that time was 94. At the age of seven and a half 
she rated 100. Annual testings for the next three years yielded 
the following results: 89, 80, and 74. Complete physical ex- 
aminations have been made to see if any cause for her failure 
to make normal mental progress could be discovered, but with- 
out success. As far as can be determined the child is and has 
always been in better than average health. Again the school 
record agrees with the changes in test standing. In the first 
two grades she did work of fair quality but now she can no 
longer keep up with her class in spite of almost heroic efforts. 

Clinicians have long been aware that although their test 
records may not show any systematic trend toward continued 
gain or loss, nevertheless some children vary much more widely 
in test performance from one occasion to another than is usual 
for the majority. Just what this instability in mental efficiency 
really signifies for the individual child is not known with cer- 
tainty but our records show that in the case of certain children, 
marked fluctuation in standing from test to test occurs with so 
much more than the usual frequency that one is justified in 
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saying that, for them, instability of test performance may be 
regarded as a relatively stable trait! 

Cases such as these, I repeat, are exceptions and not the 
rule. But the fact that they do occur, not only among our own 
records but also among those of other organizations which 
are conducting long-time studies and where the quality of the 
testing is high, should demonstrate the need for caution in 
assigning causes for unexpectedly large changes in test stand- 
ing of selected individuals or small groups. That coincidence 
does not necessarily mean causation is an axiom in all science. 
Merely because a given change in the test standing of an 
individual child is found to have occurred after some known 
change in his training, experience, or physical well-being, does 
not warrant the assumption that the one was the cause of 
the other. 

First of all, it is necessary to show that the change in test 
standing is indicative of a real change in mental capacity and 
not simply a chance fluctuation resulting from inaccurate meas- 
urement on one or the other of the two occasions compared. 
In making such comparison it is well to bear in mind that, 
other things remaining equal, the chances of an error of meas- 
urement on the first of the two examinations are somewhat 
greater than the likelihood that the error occurred on the 
second occasion, both because of the stabilizing factor of ex- 
perience with the testing situation and the greater age of the 
child at the time of the second test. Anderson and others have 
shown that the predictive value of a test as a measure of ulti- 
mate mental capacity increases directly with age at time of 
testing. 

But even when it can be shown with reasonable assurance 
that the change in standing is real and not merely an accident 
of testing, it is still hazardous to assume a cause merely on the 
basis of coincidence. Let us not forget that either the genetic 
constitution of a child or environmental factors may determine 
not only those factors that remain constant throughout life 
but also the direction and character of postnatal changes that 
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occur with advancing age. Individual differences in hair-color, 
for instance, are not ordinarily ascribed to environmental fac- 
tors. Nevertheless, of one hundred yellow-haired two-year- 
olds, some will remain blond throughout life while the hair 
of others will darken to shades ranging all the way from light 
brown to almost black. An increasing body of evidence is 
accumulating to show that mental traits as well as physical 
traits may and sometimes do undergo marked changes in the 
course of postnatal life, not because of anything that happens 
after birth but because of factors as purely genetic in charac- 
ter as those which predetermine that a particular baby’s golden 
curls shall turn brown as he grows older. 

That the results of mental tests given to young children are 
far less stable, on the average, than is true for older children 
has long been recognized by most students of mental measure- 
ment. At least three factors are probably responsible for this 
lack of consistency. Young children are far harder to handle 
in the testing situation than are older children who have be- 
come more habituated to association with strange people and 
who, as a rule, are so strongly motivated by a desire to excel 
in the test that attention and effort can be easily aroused and 
maintained. Little children, on the contrary, are rarely inter- 
ested in the tests as tests. Their cooperation depends upon 
the intrinsic attractiveness of the tasks together with a desire 
to please the examiner and win his commendation. Neither 
of these can be looked upon as highly dependable sources of 
motivation. Even with highly trained examiners, skilled in 
the management of young children, fluctuations of interest 
and effort will in all probability always constitute a greater 
source of variability in the test performances of little children 
than is true at the later ages. 

A second possible source of change in standing from age to 
age is to be found in the differential content of the tests thus 
far available for children of successive ages. The kind of 
tasks that fall within the range of ability of the very little 
child are frequently so different in kind as well as in degree of 
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dificulty from those that are suitable for the child of grade 
school or high school age that the assumption implicit in the 
common use for both of the term “intelligence test” rests upon 
insecure ground. Much further study of the relationships be- 
tween earlier and later performance of the same children is 
needed before we can be sure to what extent the tasks included 
in the scales used with preschool children are actually the 
psychological precursors of those used with older children. It 
is appropriate to point out at this point that no study has yet 
appeared that has shown any relationship whatever between 
the performance of infants under the age of eighteen months 
on any of the so-called “mental scales’ for those ages and their 
performance on recognized tests of intelligence when given 
after the age of four. This lack of relationship is equally as 
true for children reared in their own homes as for those placed 
in foster homes or in institutions, and for those with and with- 
out such specialized training as is provided by modern nursery 
schools. Whatever the reason may be, the fact that the tests 
thus far standardized for infants give no indication at all of 
what their later development is likely to be has been thoroughly 
demonstrated. 

I have stressed the matter of changes in intelligence quo- 
tients, not in order to cast doubt on their usefulness as predic- 
tive measures for the average child but merely in order to 
emphasize the fact that even the best of tests is by no means 
infallible, particularly when given at an early age. A rough 
summary of the available evidence on the extent to which tests 
given in childhood enable us to forecast an individual’s mental 
level at maturity would run something as follows: 


Before the age of eighteen months: 


No value for prediction. 


Eighteen months to four years: 


Error of prediction still large but an estimate based on repeated tests 
given during this period is far more likely to be right than wrong. 
Single tests are too unreliable to warrant much confidence and even 
repeated tests are sometimes misleading. 
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Four to seven years: 


Even a single test, if made by a thoroughly competent examiner, will 
in most cases provide a sufficiently accurate basis for judging a child’s 
potential ability to be useful for immediate guidance, and estimates of 
final capacity made on this basis are usually, but not invariably correct. 
Repeated tests are needed whenever decisions of importance are to be 
made. 





Seven years and older: 


Provided tests are properly given, changes in standing on retest as great 
as 20 IQ points are not likely to occur in more than one or two cases 
out of a hundred. It should be noted, however, that this is equivalent 
to saying that in a school with a population of 500 children, from five to 
ten cases, on the average, may be expected to show changes as great as 
this. At no age can a single test be looked upon as infallible. 






It should be noted, too, that, as McNemar has shown, the 
method of deriving the intelligence quotient carries the mathe- 
matical necessity that high [Q’s will vary more than low ones 
since the standard error of estimate of the standing of an 
individual child is a function of the variability of the chrono- 
logical age group corresponding to his mental age and not to 
that of his own chronological age. Since many of the studies 
on changes in IQ have dealt with superior groups, it is to 
be expected that greater than average change in IQ would be 
found in these investigations. 


QUESTION OF ENVIRONMENTAL INFLUENCES UPON 
MENTAL GROWTH 


With these points in mind, we are in a better position to 
evaluate certain recent studies that have attracted widespread 
attention in the popular press. These studies have to do with 
the important question of the possibility of influencing the 
course of mental growth through special training. 

I should like to say at the outset that I am not going to 
attempt any final pronouncement about the proportionate effect 
of heredity and environment in determining the course of men- 
tal growth. To me this has always seemed a foolish question— 
foolish, because it is unanswerable. Not only is it impossible 
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to separate the two in fact, but it is equally impossible to sep- 
arate them in theory or by any known statistical techniques, 
since in dealing with the human animal we never have complete 
information about either. 

Moreover, we have at present no way of knowing what 
marvels the scientist of the future may be able to accomplish. 
Consider, for example, the case of the cretin, who was for- 
merly condemned to a life of helpless idiocy. Now that we 
know the cause of his defect we are able to improve his men- 
tal condition very greatly, in some cases even to restore him 
to normality. With the advance of scientific knowledge it is 
entirely possible that other ways may be found by which equally 
startling effects upon the mentality of man in general may be 
brought about. But we must not confuse the potential with 
the real. 

The only intelligent question that we can now put is the 
highly specific one: What methods, if any, are known at pres- 
ent by which the course of mental growth can be modified? 
Concretely we may set such problems as these: Does attend- 
ance at a modern nursery school improve the mental capacity 
of children in general or of certain groups that can be objec- 
tively described? Do all nursery schools accomplish such re- 
sults and if not, how do those that seem to show such accom- 
plishment differ from those that do not? In like manner we 
may ask: If children of poor genetic expectation are reared 
in homes of superior culture, will their subsequent mental level 
correspond more closely to that of their true parents or to 
that of the foster parents? If, on the contrary, children of 
good ancestry are reared in a very inferior environment will 
their level of mental development be adversely affected? 
These are but a few examples of many direct and concrete 
questions that are subject to scientific inquiry since they are so 
phrased that they may be answered in terms of that which we 
are now able to accomplish with no implications as to what 
may eventually be possible as scientific knowledge advances. 

Although these are definite problems, they are by no means 
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simple. The hazards that beset the unwary investigator who 
attempts to find an answer that will satisfy the usual scientific 
criteria of validity are far more numerous and more difficult 
to control than might at first be supposed. It is well, there- 
fore, to examine the evidence in this field with more than usual 
care, both because of the extraordinary theoretical and prac- 
tical significance of the general problem and also because of 
the difficulty of maintaining adequate control of other varia- 
bles and the strong emotional appeal of the question itself 
which may easily lead to unconscious bias in interpreting 
findings. 


THe Stupies By LEAHY AND LAWRENCE 


In the decade that has elapsed since the publication of the 
Twenty-Seventh Yearbook of the National Society for the 
Study of Education, the question of environmental influence 
upon mental growth has remained in the foreground of contro- 
versial issues in the field of psychology. During that time, at 
least three major series of investigations and a large number 
of smaller studies have been reported in the literature. Of 
the three major studies, one, by Leahy, showed only a slight 
relationship between the cultural status of the foster home and 
the later mental development of children placed for adoption 
in early infancy. The second, a study of the mental develop- 
ment of British orphanage children by Lawrence, showed 
almost as close a relationship between paternal occupation 
and intelligence of offspring in the case of children who had 
never seen their fathers as was found for London school chil- 
dren living in their own homes. Both Leahy and Lawrence 
subjected their data to a large number of different types of 
analysis in order to check the accuracy of their conclusions, 
which, briefly expressed, were that while the evidence of each 
study pointed to a slight improvement in the mental status 
of children reared in superior environments over that which 
might fairly have been expected had they been reared by their 
own parents, the change was small indeed in proportion to 
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the total range of mental variation found within the groups 
studied. 


THE Iowa STuDIES 


By far the most extensive and varied studies on this topic 
are those which have been carried on at the State University 
of Iowa by Stoddard, Wellman, Skeels, Skodak, and their 
associates, a brief summary of which was presented before 
this group by Dr. Stoddard at the last annual meeting of 
this conference. Because of the widespread publicity that has 
been given to these studies, not merely in the scientific litera- 
ture but over the radio and in popular journals and news- 
papers, it is unquestionably necessary to examine their data 
with much care, especially since the conclusions drawn are 
strikingly at variance with the findings of most other compe- 
tent investigators. While this, in itself, is no disproof of 
the Iowa claims, since it is entirely possible that methods of 
training have been discovered there which are truly producing 
results that others have thus far failed to duplicate, we should 
be wary of assuming this to be the case without first examin- 
ing the data for evidences of erroneous or inadequate pro- 
cedures in its collection and treatment, and to see whether 
interpretations of the results other than those made by the 
authors may not be at least equally plausible. 

The Iowa investigations may be roughly classified under 
several heads: (1) studies of the effect of nursery school 
training upon child intelligence, (2) studies of the effect of 
environmental deprivation, (3) studies of the effect of later 
school training, and (4) studies of placement in foster homes, 
including the much-publicized report on the later develop- 
ment of sixteen children of feeble-minded mothers, and the 
recent study by Skeels and Dye on the cure of mental defi- 
ciency in young children by means of special training by moron 
nursemaids in an institution for the feeble-minded. If the 
results of these studies and the interpretations given them 
by their authors can be accepted as valid, their significance 
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can hardly be overestimated. On the other hand, if this 
should prove to be one more instance in which a group of 
generally competent scientists have been so carried away by 
their own enthusiasm that they have overlooked important 
sources of error in their experimental procedures, and in report- 
ing their results have failed to pay due regard to discrepancies 
which, if properly considered, might lead to conclusions very 
different from those stated, it is essential that these facts be 
discovered and made known. Let us turn, then, to a con- 
sideration of the evidence as far as it can be gathered from 
the published reports. 


Iowa STUDIES ON THE EFFECT OF 
NuRSERY SCHOOL TRAINING 


In a number of studies by Wellman, data are presented 
that appear to show that the intelligence quotients of children 
who have attended the University of Iowa preschools in- 
crease to a rather remarkable extent, a gain which is attrib- 
uted to the intellectual stimulation provided by the enriched 


environment of the nursery schools. The casual reader of 
these reports is likely to feel that a strong case in support of 
the author’s hypothesis has been made out. More critical 
study of the findings, however, raises a number of questions. 
First of all, one would like to know what precautions, if 
any, were taken to guard against the effect of possible varia- 
tion in testing procedures resulting from the examiner’s knowl- 
edge, when the tests were given, of the previous test-standing 
of the individual children and the fact of their having or not 
having attended nursery school. Everyone who is acquainted 
with the method of administering an individual intelligence test 
knows how much is left to the judgment of the examiner in de- 
ciding just how long to wait for a reply when a child remains 
silent, when to accept an “I don’t know” as final and when to 
urge further effort, how much praise it is wise to give, and so 
on. Since it is the aim of all testing to secure the maximum 
response of which a child is capable while recognizing the 
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futility of attempting to urge him beyond his capacity to 
respond, the danger inherent in the possession on the part of 
an examiner of information that might lead him to think that 
a particular child should do well, or is likely to do poorly is 
self-evident. Needless to say, I have no thought that the 
Iowa results have been intentionally influenced in this manner. 
But everyone who is acquainted with the many precautions 
taken in the psychological laboratory to guard against the 
occurrence of secondary cues that may influence a subject’s 
response without his being aware of it, must, I think, agree 
that the absence of intent is no guarantee that such factors 
have been inoperative. 

At the University of Minnestoa, definite precautions against 
the occurrence of such secondary cues have been taken. At the 
outset of our studies in mental growth, an inflexible rule was 
laid down to which we have always adhered. No examiner 
is ever permitted to look up the results of previous tests when 
administering a retest. Moreover, after the expiration of 
the period of nursery school attendance, examiners have 
commonly not known whether or not a given child brought 
in for testing had previously been a member of the nursery 
school group. As far as I have been able to ascertain, no 
such precautions have been taken at Iowa. ‘The extent to 
which their results may have been affected thereby is, of 
course, conjectural but in view of the large constant errors 
that may easily arise from such a source, it is pertinent to 
inquire by what means the gate has been guarded. 

The intelligence quotient earned by any child on a particu- 
lar occasion depends upon two factors, first his true ability 
and secondly chance. As was pointed out before, the chance 
factor alone, on the average, accounts for a much greater 
proportion of the total score earned by a young child than of 
that earned by an older one. Now if children are divided 
into groups on the basis of the intelligence quotients earned 
on a single test, the direction and magnitude of the chance 
errors as well as true differences in ability will play a part in 
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determining the grouping. The highest groups will contain 
an undue proportion of those whom luck favored and who 
therefore tested too high; the lowest groups will be over- 
weighted with those whose scores were too low. But when 
the errors of measurement reassort at the time of the second 
test, each group will regress toward its own true mean. The 
necessary result will be that unless other factors are operat- 
ing to obscure the results, the groups originally testing above 
average will lose by an amount equal to the algebraic mean 
of the chance error for each group; those originally testing 
low will gain in corresponding fashion. If, as often happens, 
emotional factors such as shyness, lack of interest, nega- 
tivism, and the like were present to a greater extent at the 
time of the first than at the time of the later test, with the 
result that the percentage of children earning initial scores 
that were too low exceeded the percentage whose scores were 
too high, it follows as a necessary consequence that the regres- 
sive “gains” of the initially low group will exceed the appar- 

t “losses” of the high groups. Needless to say, neither the 
gains nor the losses can be looked upon as indications of true 
changes in ability unless it can be shown that the amount of 
the gain or loss exceeds that to be expected on the basis of 
the known unreliability of the tests used for children of the 
ages studied. 

In practically all of the investigations that have appeared 
from the Iowa laboratory, the type of analysis just described 
has been used. Their claims for the stimulating effect of 
preschool environment rest chiefly upon the “‘gains’’ made by 
the children whose initial intelligence quotients were low. 
Although they have pointed out that children who at first 
tested high either fail to gain upon retest or show an actual 
loss, they have apparently failed to see that if the gains of 
the one group are accepted as real, and due to the training 
received in the nursery school, consistency of reasoning de- 
mands that we also regard the losses of the second group as 
equally real and likewise the result of nursery school train- 
ing. The necessary conclusion would then be that bright 
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children should under no circumstances be permitted to attend 
the University of lowa nursery school because of the likelihood 
that serious and lasting damage to their mentality may result! 
Of course this is just as absurd as it sounds. The fact is 
that both “‘gains” and “‘losses’’ are due, at least in large part, 
to statistical fallacy. Whether or not anything would remain 
if correction for the regressive error were made cannot be 
said from the data at hand. Such correction could, however, 
easily be made by those in possession of all the facts. 


MENTAL ‘“‘DETERIORATION”’ DuE To PooR ENVIRONMENT 




























The effect of a psychologically impoverished environment 
upon mental growth has been vividly described in a mono- 
graph by Skeels, Updegraff, Wellman, and Williams which 
is based upon an experiment set up in an orphanage at Daven- 
port, lowa. The authors state that the children in this 
orphanage were given excellent physical care but were grossly 
neglected in all other respects. They had practically no toys, 
little play space, and only such association with adults as was 
essential for their physical care. Intelligence tests indicated 
a generally low level of mental development. 

In this orphanage a model preschool was set up. Each 
child who was admitted to the preschool was paired with an- 
other child of similar age, sex, and intelligence quotient who 
remained in the unstimulating environment of the orphanage. 
Unfortunately for the experiment, however, this grouping did 
not remain stable since children were continually being re- 
moved from both groups for placement in foster homes or 
for other reasons. This necessitated their replacement in the 
study by others who did not always completely fulfill the 
conditions of matching. For this and other reasons the report 
of the findings is not easy to follow, and the reader is accord- 
ingly tempted to pass over the many figures and tables rather 
hastily and turn to the conclusions given by the authors with- 
out giving sufficient heed to the nature of the evidence upon 
which these conclusions are based. When, however, the 
numerical facts as presented in the body of the monograph 
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are compared with such extreme statements as the following, 
one cannot but feel that the zeal of the authors to establish 
the new gospel has blinded them to all facts not in conformity 
with it. For example, on page 185 of the monograph just 
mentioned it is stated that, ‘““Taken all in all, the preschool 
exerted a profound influence upon the children during the 
period of preschool enrollment and probably in a number of 
instances changed the whole tenor of their later lives. Some of 
the children were made placeable who almost certainly other- 
wise would have been doomed to commitment to an institution 
for the feeble-minded or at best would have continued to reside 
in the orphanage.”” And on page 55, ‘‘Regardless of initial 
classification, all groups of control children headed for a final 
classification between 70 and 79 IQ. The effect of long resi- 
dence for control children was a leveling one, tending to bring 
all children to high-grade feeble-mindedness or borderline 
classification.” Strangely enough, however, this alleged 
“leveling” effect did not reduce the standard deviation, which, 
for the control children, is given as 12.4 IQ points at the 
time of the initial test and 12.6 on the final test for the small 
group with the longest period of residence. 

As far as the effect of preschool attendance upon the mental 
status of the children is concerned, the actual difference be- 
tween the experimental and control groups can best be judged 
by a cumparison of the figures shown in the following list, 
which summarizes for all cases the differences in IQ between 
the first and last testings. These figures, not given in the 
monograph, were compiled by L. M. Terman from the origi- 
nal data which were supplied by Wellman at his request. You 
will note that large changes both in the upward and down- 
ward directions occurred in both groups. Further comment 
is unnecessary, as the figures speak for themselves. 


Preschool group. +-25, +19, +17, +14, +12, +12, +12, +11, 
+9, +9, +8, +8, +7, +7, +6, +6, +5, +5, +5, +5, +4, +4, 
+3, +2, +2, +1, —I, —2, —3, —3, —4, —4, —4, —4, —4, —5; 
ae ne. —8, —8, —D, —9Q, =i Ss —=i 35 —Z4, =< 
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Control group. +27, +22, +17, +17, +17, +16, +14, +11, 
+9, +8, +8, +8, +7, +6, +4, +2, +2, +2, +2, +1, +o, —1, 
m3, —. — ==, =F —- ——-. —, —8, ——, ——T@, ~—= 5G, ——35G0, 
“Ey “Ess 2a =i “so. “Sa "ae —aes "4 


















The two greatest losses in the control group were both 
made by children whose first test was given near the age of 
18 months. 


STUDIES FROM OTHER SOURCES 





























Before leaving the subject of the effect of nursery school 
training upon child intelligence it may be well to note some 
of the most recent findings from sources other than Iowa. In 
the forthcoming Yearbook of the National Society for the 
Study of Education, a total of nine investigations on this 
topic will be reported. Of these, the following eight child 
welfare research centers found no evidence of improvement 
in mental standing as a result of nursery school experience: 
the University of California, Western Reserve University, 
the University of Michigan, the Rhode Island College of 
Education, the University of Cincininati, the Utah State 
Agricultural College, the Winnetka School System, and the 
University of Minnesota. Only one report, that from the 
Merrill-Palmer School, purports to show a positive effect of 
nursery school experience upon test results. Examination of 
the data from this study raises considerable doubt as to 
whether such effect can justifiably be said to have occurred. 
The study is based entirely upon IQ changes in nursery school 
children with no control group. The statistical treatment fol- 
lows the Iowa pattern with cases divided according to their 
standing on the initial test, and the results show the usual re- 
gressive shifts with the cases originally testing high appearing 
to lose and those originally testing low appearing to gain. For 
the group as a whole, the mean gain when tests given at the 
end of the nursery school period are compared with those 
given at the time of entrance is 4.1 IQ points. This gain is 
rather smaller than those found both at the University of Min- 
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nesota and the University of California, not only for children 
attending nursery school but also for those without nursery 
school experience when tested after corresponding intervals of 
time. Experience in taking the tests, with the accompanying 
factors of lessened tension and better emotional adjustment, 
seems to be a more plausible explanation of the Merrill- 
Palmer findings than that given by the authors. 


SUMMARY OF NURSERY SCHOOL STUDIES 





It appears, therefore, that the Iowa claims for the effect 
of nursery school training upon the intelligence of children 
cannot be extended to schools other than their own and that 
until the questionable matters inherent in the Iowa data are 
cleared up, we should at most suspend judgment in regard to 
their validity. To my way of thinking, it would be highly 
unfortunate if the idea should become widespread that the 
chief function of the nursery school is to boost the IQ. Not 
only is such a concept likely to lead to bitter disappointment 
on the part of many parents, but the effect upon the kind of 
training offered, especially in the smaller private schools run 
by persons with only a moderate amount of professional 
sophistication, may be distinctly undesirable, if, as is possible, 
the emphasis should be shifted from the provision of oppor- 
tunity for healthy social intercourse and training in funda- 
mental habits to the premature acquisition of abstract knowl- 
edge that is normally gained at a later age. That the nursery 
school serves a very real function in the modern world of 
small apartments and small families where life is geared to 
a higher ratio than the little child is equipped to meet has 
been thoroughly demonstrated. As for its effect upon intelli- 
gence in the proper sense of the word, our verdict must be, 
Not demonstrated. 


OTHER STUDIES FROM THE IOWA LABORATORY 


Time does not permit me to make more than a few brief 
comments upon the other studies that have appeared from 
the Iowa laboratory. Generally speaking, the same questions 
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that have been raised with regard to the nursery school inves- 
tigations also apply to those dealing with the effect of later 
school training and of placing children in foster homes. We 
may note in passing that the practice of averaging percentile 
ranks which has been generally employed by the authors in 
their studies of the effect of training in the University of 
lowa Elementary School and the University High School is 
statistically unwarranted because of the unequal spacing of 
percentiles which renders the middle ranges incomparable 
with the extremes. Moreover, the children not attending the 
University schools who were used as controls had much less 
experience with testing than the University group, which 
would give the latter an unfair advantage in respect to prac- 
tice effects. When allowance is made for these factors, little 
evidence for superiority of one group over another remains. 

Most, if not all, of the studies on the later development 
of children in foster homes that have appeared up to the 
present time have led to the conclusion that when the place- 
ment is made in infancy or early childhood, the later mental 
development of the children is usually somewhat superior to 
that which might fairly be expected on the basis of their true 
parentage. Of the four large-scale investigations that pre- 
ceded the Iowa studies, those by Burks, Leahy, and Law- 
rence agreed in assigning a small but measurable effect of the 
foster home upon child-intelligence, while Freeman concluded 
from his data that genetic and environmental influences were 
about equally potent. Both Leahy and Freeman found a ten- 
dency for children of superior family background to be placed 
in superior homes and vice versa, hence some relationship be- 
tween the character of the foster home and the level of 
ability of the foster child would be expected on a genetic basis 
and could not be attributed solely to the influence of the foster 
home. In the lowa studies by Skodak and Skeels, selective 
placement on the basis of the child’s family history was also 
indicated by a correlation of +.30 between the mid-parent 
education of true and foster parents. 

The 154 children who served as subjects in the main study 
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of foster children that has been reported from lowa were 
all placed in foster homes before the age of six months and 
were first tested at a median chronological age of 19 months. 
Since tests given at so early an age have practically no predic- 
tive value, it is not surprising to find that the intelligence quo- 
tients earned at that time showed practically no relationship 
to any measured characteristics either of the true parents or 
the foster home. 

All children were retested after the age of two years. The 
median age at the time of the second test was 49 months. 
The mean IQ at the time of the first test was 116, on the 
second test it was 111.5. When the results of both testings 
were thrown together and grouped according to the age of 
the child at the time of testing, a regular and even downward 
trend with advance in chronological age was found, from a 
median of 122 for tests given before the age of 18 months 
to 108.5 for those given at six years. If one were to inter- 
pret these results in the same manner as other findings by the 
same authors have been interpreted, he might thus conclude 
that continued residence in a superior foster home results in 
a median loss of 13.5 IQ points by the age of six years. This 
compares with a mean loss for the orphanage controls of 
4.6 points.’ A more likely interpretation would be that the 
early tests, which are made up chiefly of perceptual-motor 
items, have in truth very little in common with that which we 
later call “intelligence.” But if this point of view is accepted, 
it follows that the elaborate analysis of changes in IQ from 
first to later test which makes up a large portion of the study 
becomes meaningless, since the significance of a measured dif- 
ference disappears if either of the measures from which it 
was derived is invalid. 

Let us turn, then, to the evidence from the second test. 
The mean IQ of 111.5 is in all probability somewhat higher 
than would be expected on the basis of family history alone— 


* Based upon cases with 400 or more days’ residence. 
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and this is in accordance with previous studies—but it seems 
unlikely that the increase amounts to more than a few points. 
Leahy has shown that illegitimate children released for adop- 
tion do not constitute a representative sample of illegitimate 
children in general but come from families who are distinctly 
superior, on the average, to those of the rank and file of chil- 
dren born out of wedlock. In the Iowa group of 154 cases, 
the educational level of 66 of the true fathers was unknown; 
of the remainder, 39 per cent had completed high school or 
better. Of the true mothers, 33 per cent had completed high 
school or had taken some college work. Of the 88 fathers 
whose educational level was known, 9 were still in school or 
college and of the 144 mothers, 22 were ‘‘too young to have 
been employed or were students living at home or were men- 
tally incapable of holding positions.” Although this lumping 
together of educational extremes is confusing, it is neverthe- 
less evident that not all the true parents of either sex had 
completed their schooling at the time of the child’s birth. 
The educational picture would thus have been somewhat more 
favorable had it been taken at a later age. The same thing 
is true of the distribution of occupations, since it is evident 
that many of the true parents were still too young to have 
attained their ultimate vocational rank. All in all, the facts 
as given hardly seem to correspond to the descriptions of 
extreme inferiority on the part of the true parents that have 
frequently been given. 

If the influence of the foster home were the paramount 
factor in determining the level of intelligence, one would ex- 
pect to find significant correlations between child IQ and such 
factors as education of the foster parents, occupation of the 
foster father, and so on. Even at the time of the second test, 
however, these relationships are negligible. Curiously enough, 
however, when comparison is made with the same factors as 
recorded for the true parents, significant though low correla- 
tions appear. The correlation between child IQ and foster 
father’s education was +.16, with foster mother’s education it 
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was +.19, and with mid-foster parent education it was +.18. 
For the true parents the corresponding figures are, +.29, 
+.28, and +.33. These figures do not differ materially from 
those obtained in other studies in which the subjects were 
children of corresponding age but reared in their own homes. 
At the University of Minnesota, a correlation of +.35 was 
obtained between the 1Q’s of 218 preschool children and mid- 
parent education. 

Perhaps the most startling of the Iowa reports are those 
dealing with the later development of children whose true 
mothers were said to be feeble-minded and with the cure of 
feeble-mindedness through training by morons. In consider- 
ing the first of these studies, several facts from the main 
study of 154 children need to be held in mind. For the 
group as a whole, a fairly clear-cut relationship between edu- 
cation of the true mother and child IQ was established—the 
mean IQ for those whose mothers had only grade-school edu- 
cation was 107, for those whose mothers had high school edu- 
cation it was 113, and for those whose mothers had gone 
beyond high school, 120. But the correlation between 
mother’s IQ and child IQ for the 80 mothers who had been 
tested was practically zero. This is so contrary to usual find- 
ings that some question as to the validity of the tests is war- 
ranted. By direct inquiry of the authors, I have learned that 
the mothers were all tested during their period of residence 
in the maternity hospital. Whether or not this is an adequate 
explanation for the absence of the expected relationship can- 
not be said with certainty, but the possibility should certainly 
be kept in mind. If the tests were invalid, however, the diag- 
nosis of feeble-mindedness that was made for the sixteen 
mothers in the special study may likewise be called into ques- 
tion. It should be noted, too, that these were all illegitimate 
children for whom the question of paternity is usually uncer- 
tain even when “established” by law. The mean education of 
15 of the mothers was 7.6 school grades completed, that of 
10 of the putative fathers was ninth grade. For the remain- 
ing cases, no information is given. 
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Certainly, the wide publicity that has been given to this 
report is unfortunate and until it has been carefully verified 
from other sources it should not be accepted as a basis for 
child-placing procedures. A case has recently come to my 
attention that illustrates the dangers involved. The illegiti- 
mate child of a feeble-minded woman had been placed in a 
boarding-home of superior type at the age of three months. 
The foster parents, in the course of time, became much at- 
tached to the boy and wished to adopt him. Because of his 
family history, together with the fact that intelligence tests 
that were administered as he grew older indicated that, 
although probably not feeble-minded, he was certainly below 
average mentality, adoption was not recommended. The 
parents, however, had read an account of the lowa experi- 
ment and were convinced that the family history could be 
safely ignored. They insisted that the adoption be carried 
through, a procedure to which the agency reluctantly con- 
sented. The boy is now seven years old, his IQ is still in the 
low 80’s, while a foster brother, the true child of the adoptive 
parents, has an IQ of 125 and, though younger, is already 
surpassing him in accomplishment. Inevitably, comparisons 
between the two are made in the school and neighborhood 
and the effect upon the adopted boy is very apparent. Had 
he been placed in a home more suited to his mental level, he 
might have been saved much unhappiness. 

One is tempted to be somewhat facetious about the last 
of the lowa studies, which purports to show that moron nurse- 
maids in an institution for the feeble-minded are able to stimu- 
late the mental growth of feeble-minded children placed under 
their care to a degree that makes the best efforts of the Uni- 
versity of Iowa child welfare experts seem feeble indeed. We 
are told that within the relatively short space of six to twenty- 
four months the mean increase in IQ of thirteen children was 
28 IQ points. This may be compared with a mean gain of 
4.6 IQ points as the result of 400 or more days’ training by 
child welfare experts in the nursery school set up in the 
Davenport orphanage previously mentioned. The answer 
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may perhaps lie in the fact that the diagnoses of mental defi- 
ciency were made at a median age of 16 months and the 
reported gains in IQ go back to tests made between the ages 
of 7 and 30 months. 


COMMENT 


In closing, I should like to say once more that these criti- 
cisms, harsh though they may sound, are not meant to suggest 
that the Iowa data have been intentionally misrepresented. 
I believe that they have been misinterpreted. I might go 
further and say that in the course of well-nigh a decade of 
study, the Iowa attitude seems to have gradually shifted from 
what, I think, was at first a comparatively impartial search 
for the facts to that of a selective search for those facts that 
seem to confirm their theory. In my opinion this was brought 
about by premature and widespread publicizing of conclusions 
that were so amazing as to demand apparent substantiation 
by figures of impressive magnitude. I have pointed out some 
of the statistical fallacies by which these figures were derived 
and the best proof that I can offer in support of my personal 
conviction that they were presented in good faith is the simple 
fact that they have been published at all! The points that I 
have raised are but a few of many that have been noted not 
only by myself but by others who have taken the trouble to 
examine the data with some care and whose critiques will 
shortly be published.? You will find these reports well worth 
reading. 

Finally, I may add that in spite of what I regard as a mis- 
taken conclusion, I believe that the net results of this contro- 
versy, as with many others that have preceded it, may be 
beneficial rather than harmful. In so far as it has placed a 
greater emphasis upon the need for providing for every child 
suitable opportunity to develop healthy ways of behaving, of 


* See especially “A Critical Examination of the University of lowa Studies of 
Environmental Influences upon the IQ,” by Quinn McNemar. To appear in a 
forthcoming number of the Psychological Bulletin. 
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giving food for the mind as well as for the body, the effect 
upon those who are charged with the rearing of children 
should be favorable. Even the errors of experimental tech- 
nique may serve a valuable end if, as is to be hoped, they 
serve to call the attention of others to the need for stopping 
all possible gaps in the conduct of an investigation, in order 
that the conclusions that finally emerge will bear the impress 
of sound authority. 





The Selection of Teachers from 
the National Viewpoint 
By A. J. STODDARD 


, | THE subject that we are to consider for the next few 
minutes is a very practical one and will concern those 
of you who are directly interested in either the produc- 

tion of teaching, or teachers, or the consuming of teachers, or 

teaching. 

I am speaking this morning more as the chairman of the 
National Committee on Teacher Examinations than as a 
superintendent of schools, although the latter fact will natu- 
rally color much that I shall say. 

I remember sitting at my desk in the first part of August 
1927, with several vacancies yet to be filled in our staff for 
the beginning of the school year, and thinking that I would 
almost rush out into the street and stop the first car that 
came along and ask the people in the car if they were teachers 
looking for positions. We had several vacancies, as I have 
said, and no one to fill those vacancies. In the afternoon two 
ladies who had never heard of our city except casually came 
along and happened to stop in our office. They were on their 
way to the West Coast. I found out that they were teachers 
from an eastern state, and I prevailed upon them as per- 
suasively as I could to stay and teach in that city. We con- 
tracted with them before they left on.that day. That was 
the situation twelve years ago! 

At the present time, there are on the waiting list—those 
that have qualified for positions—in the city of Philadelphia, 
more than 3,000 people. No appointments have been made, 
except a few scattered ones, for three years, and it is very 
likely that we shall not make anywhere near the normal num- 
ber of appointments in the next three years. That is the 
situation that is prevailing very generally over the country. 
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Of course, there are exceptions in some particular communi- 
ties. 

That change has come about in twelve years, due to a 
combination of economic conditions, but probably mostly due 
to the fact that for the first time in the history of public edu- 
cation in America we are facing a decreasing market. The 
decrease in the number of children in a city like New York 
is almost beyond our belief. In the city of Philadelphia the 
decrease in the elementary grades has been at the rate of 
between five and six thousand a year for the last four or five 
years. This decrease in enrollment is producing a surplus of 
teachers greater than the normal rate of retirement of 
teachers. 

Nationally, we are facing a situation where we are produc- 
ing in our teacher education institutions many more teachers 
than can find positions in the schools. Another great change 
in teacher education in recent years has come as a result of 
the fact that the schools of this country are no longer exclu- 
sively emphasizing the teaching of facts, knowledge, and 
skills, as they did formerly. Today the teacher must be pre- 
pared to deal with not only facts, knowledge, and skills in 
wide areas, but also with those imponderable objectives that 
we group under the headings of attitudes, appreciations, and 
ideals. 

The form of teaching that we designate the “activity pro- 
gram” has called for a very much higher type of teacher than 
was needed in the past, a teacher who knows much more about 
the culture of our day, who is much more alive to the world in 
which he is living. As a matter of fact, we now say that the 
teacher who is not aware of the culture of our day or is not 
aware of the happenings of the world of which he is a part 
is not fitted to teach in the modern school. 

I do not need to take any more time to emphasize the fact 
that the situation is now such as to make it possible for us to 
skim the cream, so to speak, off of the candidates for teach- 
ing positions in this country. There are several implications 
of the statements that I have just made that I shall not have 





146 The Educational Record Supplement for January 1940 


time to discuss. One of the implications concerns the teacher 
education institutions themselves: whether they shall more 
thoroughly enter into the processes of selection and more 
thoroughly enter into the processes of teacher education, both 
pre-service and in-service, than they have done in the past. 
It is not my purpose to discuss that question this morning. 

We are confronted, as I say, with the situation now in 
which it will be possible, if we take advantage of conditions, 
to select in the days that lie immediately ahead of us the very 
highest type of teacher. It depends on us whether we have 
the ability to set up the means for determining the highest 
type among the candidates who offer themselves for teaching 
work. 

The National Committee on Teacher Examinations has 
been established to deal with one small area of this whole 
field of teacher selection, that of the objective examinations. 
Many school systems are now using a plan very similar to the 
one that I shall briefly describe. They set up a certain number 
of points, let us say 1,000 points, upon which the teaching 
candidate is rated. The first 300 points may be based upon 
the results of objective examinations in wide, general fields, 
such as familiarity with current events, world affairs, the cul- 
ture of the day, professional facts, knowledge, and skills that 
should be a part of the teacher’s equipment, the psychological 
examination or something equivalent to that, and so on. 

Then a certain amount of the total rating is turned over to 
an appraisal of the candidate’s equipment in specific subject- 
matter fields, such as, let us say, a major and a minor, possibly 
mathematics and language. If it is in the elementary school 
field, it might be in such a major as English, and a minor, in- 
cluding a number of the subjects covered in the elementary 
school field. 

Then the next part of the rating might be a number of 
points, say 200, given to an appraisal of the training and ex- 
perience of the candidate that have any relation to his equip- 
ment for teaching. 


The last 300 points might be a personality appraisal of the 
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teacher. This personality appraisal would be made not in the 
old hit-and-miss, casual fashion that has prevailed very largely 
in the selection of teachers up to now, but would be done on 
the basis of all the knowledge that the field of psychology can 
give to us. It would be the result of the application of all 
the knowledge that we can possibly rally from the field of 
human development, human growth, and so on. 

Then the candidate’s position is determined on a list, an 
eligibility list derived from these parts added up for the total. 

In the fifteen or twenty larger cities which are using some 
plan of rating teacher candidates, this plan that I have de- 
scribed is roughly the plan used. There are, of course, some 
local variations. The rating will differ from city to city, but 
the elements of general background and culture which I have 
enumerated are determined by tests. The equipment of the 
teacher in specific subject-matter fields is determined by tests. 
One’s equipment through going to school and through partici- 
pating in the activities of life is evaluated by an appraisal of 
a record of that fact. And finally, an appraisal of personality 
is done by more than one person, usually a committee. 

It is the proposal of the National Committee on Teacher 
Examinations to try to better the part of the process that 
has to do with examining in a written manner the qualifica- 
tions of the teacher. That is the part of the process of ap- 
praising teaching candidates that is usually more poorly done 
than any other part except the personality appraisal. 

A study that has been made of the examinations used by 
these cities reveals the fact that these examinations are very 
largely still subjective in type, although the groups adminis- 
tering them will usually not admit that to be the case. We 
find that the examinations are not only subjective, but they 
are very narrow in some cases. ‘The very construction of 
them weights unduly certain phases of the teacher’s education. 

We propose—and it is not being done commercially at all 
but through a subvention from the Carnegie Foundation for 
the first three years, and we hope after that time to be self- 
sustaining—to set up a national system of examinations. This 
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year we expect to give the examination on March 28 and 29, 
1940, in some dozen or more centers strategically located 
throughout the country. 

The teaching candidate will go to one of those centers if 
he wants to be able to submit as a part of his record the 
results of taking these examinations. He will pay the fee 
which has been established at five dollars for this first year. 
Let me say, parenthetically, that it is very likely that this fee 
will have to be raised after the subvention from the Carnegie 
Foundation expires, but for the present it has been set at five 
dollars. This five-dollar fee will enable the teacher to take 
a battery of tests, lasting through a two-day period. The 
correction of these tests will give him a percentile rating in 
comparison with all the people in the United States who took 
the test. He will know whether he stands fifty-ninth through- 
out the country, or seventy-sixth, or ninety-eighth and so on. 
He will know, as a result of taking the test, his percentile 
rating on the various component parts of the test. He will 
have the record of the examination results to submit wherever 
he is applying for a teaching position. He will be furnished 
one record and an additional record to be submitted to one 
place. Any records in addition to those must be purchased 
for a small fee. 

Let me emphasize, while I am mentioning the matter of 
fees, that everything in connection with the examination pro- 
gram is being reduced in cost just as low as possible in order 
that this whole plan be not too much of a burden on the indi- 
vidual candidate during its initial stages, at least. 

There will be printed very shortly and distributed to those 
of you who are interested—and if you do not receive a copy 
without asking for it, please write to the headquarters of the 
National Committee on Teacher Examinations and ask for 
a copy—a small pamphlet that will give all the details in 
reference to the plan of conducting the examinations. The 
part that I want to mention specially this morning is that if 
your particular locality may be interested in being designated 
as one of the places where the examinations are to be given 
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this first year, you should make application. A superintendent 
of schools, or a director of a teacher training institution, or 
any group of people interested in having a center established 
in a certain place should make application within the next 
fifteen or twenty days, and consideration will be given to the 
request. 

You notice that the local authorities will not be the ones 
to give the examinations. Let us say that Omaha might be 
established as one of the centers where the examinations are 
to be given. The local authorities would be very much 
interested in the fact that the examinations are to be given 
there. The part that they would have would be only one of 
advertising the fact that the examinations are to be given, 
advertising the significance of the examinations, telling the 
people who are interested when they are to be given, and 
where they are to be given. That is, their part is one of 
cooperation in order that results that they want may be avail- 
able for their use later. 

The National Committee on Teacher Examinations will 
make the contact with the community where the examinations 
are to be given, will set up local agents to act in giving the 
examinations, in sending the papers to New York where they 
will be machine-corrected, and in making the final scores avail- 
able to the candidates, according to the addresses that they 
gave when they filed for the examinations. 

To many of you this is not a new procedure. It sounds 
very much like a description of the College Board Examina- 
tions, and it is patterned somewhat after that plan. 

Let me say just this one thing in conclusion. When there is 
a teaching position and there is one candidate for that posi- 
tion, we do not need to worry so much about setting up criteria, 
standards, and plans for selecting the candidate. Of course, 
the individual community is interested that the right one get 
into the right position, but from the standpoint of the 
nation—and I am trying to think of this matter from that 
standpoint this morning—if there is only one candidate for 
each one position, or if there are 100,000 positions open each 
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year and there are only 100,000 candidates, after a while the 
100,000 candidates will get into the 100,000 positions, and 
nationally we are not so concerned with the question of selec- 
tion. The individual community still is concerned. But when 
there are 100,000 positions and 1,000,000 candidates, when 
there are twice the number of candidates that there are posi- 
tions, or twenty times the number of candidates that there are 
positions, America becomes very much concerned with some 
plan for determining who are the best among those candidates. 

We are offering a service, and it is a professional offer of 
professional service, to help America pick from among those 
who would go into teaching those who are best qualified. We 
are not offering the whole process. Later on we hope to be 
of some help in the personal interview that is carried on with 
the candidates. We are not offering that help at the present. 
We do not know much about it ourselves. We are not offer- 
ing any help in the appraisal of the teacher’s record pertinent 
to teaching. We do not know so much about it ourselves. 

We are at present planning to offer help in that one phase 
of the process of selection of teachers, the written examina- 
tion. We are not offering help to the locality that wants to 
determine the extent to which the teacher can make functional 
use of the knowledge he has. ‘That must be left for the 
present with the local community. In other words, we can- 
not give performance tests in the subjects where performance 
is a highly desirable part of the teacher’s equipment, as in 
physical education, or in certain of the languages, or some- 
thing of that sort. We cannot test very adequately, at pres- 
ent, the teacher’s ability to teach. 

What we are trying to do in these tests is to measure the 
teacher’s equipment from the standpoint of facts, knowledge, 
and skills, and to some extent, so far as it can be done through 
written tests, the ability to use such facts, knowledge, and 
skills functionally. We hope that, through these tests and 
through your use of the results of the tests, we shall be able 
to discourage the going into teaching of those people who just 
have not the fundamental equipment that a teacher should 
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have to succeed in teaching these days. I happen to be a 
member of the national committee that is dealing with this 
whole subject of democratization of the schools. We have 
agreed in the very beginning that the schools of this country 
are more or less stymied in trying to work out the problems 
of democratization of the schools because of lack of ability 
on the part of so many of our teachers. We start—not we, 
but all of us in the profession—with an intensive program of 
trying to impart the culture of our race, that which is Ameri- 
can and part of the heritage of all of our people, and we find 
that so many of our teachers are not familiar with the cul- 
ture of the race, are not equipped with the elements of culture 
essential to making that culture possible for the people. 

To be more specific, we are only tapping the resources for 
happiness that lie in the field of music. One reason we are 
doing so little with that subject is that so many of our teachers 
have so little equipment in the field of music. The same is 
true with art. I could name any number of other fields where 
this is true. The biggest single force—and I say this with 
as high a regard for the teachers of America as has any per- 
son in this room—that is preventing public and private edu- 
cation in America from going the whole way in making the 
schools of America actually serve the culture, the democracy, 
the times in which the schools exist is the lack of equipment, 
the lack of fundamental equipment on the part of teachers, 
principals, and superintendents of schools, and I might also 
say college professors and college presidents. I want by what 
I say to run the whole gamut of the profession. 


Note: The address was followed by an extended discussion in which Dr. 
Stoddard answered many detailed questions about the examinations. All these 
details and others are covered in a recent pamphlet which Dr. Stoddard men- 
tioned and which may be obtained by writing to Dr. Ben D. Wood, director of 
the Cooperative Test Service, 500 West 116th Street, New York City. 





Education and the Future of the Public 
Service 
By LUTHER H. GULICK 


HANGES in the environment in which we all live and 

(C work have a way of sneaking up on us without giving 

us advance notice, without even informing us vigorously 

that the change has set in and that we are living in a totally 
new situation. 

I imagine that that was precisely the situation and the feel- 
ing of the mastodons when the Ice Age fears descended upon 
them. They said, “‘Isn’t it a little chilly around here, and a 
little uncomfortable?’ When you feel a little uncomfortable, 
remember the mastodon! It may be that there has come over 
the environment in which you live a new situation which must 
be faced with a new program. 

One of the important changes that has come over us in re- 
cent years is the development of the public service as a major 
human activity. Having been treated this morning to such a 
penetrating discussion of the problems of psychology in statis- 
tical terms by Dr. Goodenough, perhaps I may be excused for 
presenting a few statistics. I know you can take it. That is 
not true of all audiences, even in the state of New York. My 
right-hand neighbor tells me that statistics are always a pit- 
fall, that anyone who presents them is to be suspected. 

The development of the public service in America over the 
last thirty or forty years represents a tremendous change in 
our whole environment. Back in 1900 the United States gov- 
ernment was employing for every 100,000 population about 
300 employees. At the same time, the state of New York was 
employing about 111 employees for every 100,000 population 
within the state, and the city of New York at that time was 
employing about 878 employees for every 100,000 population. 
These people—city, state, and nation—were serving the people 
of the city of New York in various ways. 
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You come down to 1930 and you find the federal number 
went up from 300 to almost 500 employees. And when you 
look at the picture for 1939, on the basis of figures just re- 
cently announced, you may say that there are working for the 
federal government 700 employees for every 100,000 people 
in the population of the United States. Taken for the United 
States as a whole, from 1900, when we had about 1,300 people 
in public employment for every 100,000 in the population, 
we came down to 1930 with 2,600, a doubling of the public 
service, and in 1939, nine years later, we have 2,930, or the 
addition of another 330 employees in that period. 

At the present time, the federal government, the state gov- 
ernments, and the local governments employ in this country 
3,800,000 people, working as public servants. That includes 
teachers. It includes the rank and file of municipal police, fire, 
clerical, tax, and all other services, but does not include those 
who are being supported by the government on relief. It 
includes the military services. 

You cannot dip into the rolls of graduates of any one of our 
institutions of learning, particularly those of higher learning 
and the professional schools, without discovering a large pro- 
portion, a startlingly large proportion, who have gone into 
the service of the public. As indicative, you may accept the 
recently issued study from the University of Minnesota which 
covers a period of eight recent years. This study shows that 
of those graduating in agriculture, forestry, and home eco- 
nomics, which means going on, you see, for specialized work, 
84 per cent of the men, and 65 per cent of the women had 
within the period of eight years after graduation found em- 
ployment either for all of the period or part of the period in 
federal, state, and local governmental services. In business 
administration, 23 per cent of the men and 37 per cent of the 
women had also gone into the public service. In chemistry, 32 
per cent of the men, and in dentistry but 9 per cent, went into 
the public service. In law, 24 per cent, almost one-quarter, 
entered the public service. In engineering and architecture, 
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46 per cent of the men had found public employment. In 
medicine, 28 per cent; in mines and metallurgy, 35 per cent; 
in pharmacy, 6 per cent; in science, literature and arts—these 
are the arts students—31 per cent; and in education, 28 per 
cent had gone into the public service. For the grand total, and 
this study covered returns from over 5,000 students, a sam- 
pling of about one-third of the graduates of the institution in 
the period covered, over 30 per cent of the men and approxi- 
mately 28 per cent of the women had been in public service 
at one time or another. 

In other words, both from the standpoint of government- 
service statistics and from the standpoint of employment sta- 
tistics of the graduates of our institutions of higher learning, 
you find a large percentage now going into the public service. 
This percentage has risen rapidly. It represents without doubt 
a permanent new factor in American life. During the course 
of the last few years, a second factor is to be noted, and that 
is the great extension of the merit system. 

I suppose those of us interested in education should have 
rejoiced in the good old Jacksonian system of rotation in office, 
because then we could look upon public office as merely a post 
of education and training in which every citizen was entitled 
to have his opportunity. In the days when anybody could 
get the appointment on the basis of personal connection and 
friendship and was expected to remain but a few years, and 
then was to give way to someone else, we felt that the prob- 
lem of educating for the public service was impossible. No 
one needed education. Jackson once said: ‘“The duties of all 
public offices are, or at least admit of being made, so plain 
and simple that men of intelligence may readily qualify them- 
selves for their performance.”’ As a matter of fact, the re- 
action has been just the opposite. 

The demands for service and the rise of professional tech- 
nologists in all lines in civilian life have gradually convinced 
even the average man that he does not want a bridge built 
by someone who has no engineering knowledge. He does 
not want medical service by someone who has no knowledge 
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of medicine. He does not want his children taught by some- 
one who has no training in education. 

So we have reached the point where there is a spreading 
demand for the merit system, or civil service reform, as it 
is sometimes called, throughout the country. 

During the last few years we have had half a dozen states 
enact civil service laws. We now have over 700 govern- 
mental units within the United States, including states, munici- 
palities, counties, and so forth, that have definite personnel 
administration divisions and departments, sometimes called 
civil service commissions, sometimes called personnel admini- 
strations. 

During this year there will be not less than seven states 
definitely considering civil service reform by legislation, and 
I expect that three or four of these states will pass civil serv- 
ice laws. All of this represents a very rapid development 
since the report of the Commission of Inquiry on Public 
Service Personnel was presented. 

This extension of the merit system is particularly significant 
at this time in American history because civil service reform 
today, instead of being a negative effort to keep out the 
rascals, a negative effort to prevent individuals who had been 
appointed to public service from being discharged, has now 
become increasingly a positive effort. The municipality, the 
state, and the nation—each has gone forward to reach out 
and get people of qualifications to come into the public service. 

The new program is to search out and find competent indi- 
viduals who are qualified to grow in the service, qualified to 
spend a lifetime working out a career within the public service. 
Thus you have the change from a negative, defensive war 
against spoils to a positive and constructive effort to attract 
and hold competence. 

This means that increasing attention is being given to the 
training and recruitment of individuals for the public service, 
and to their native capacities and their promise of develop- 
ment and growth. Obviously, if government personnel 
departments are going out to look for people, to look for 
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people who have acquired certain knowledge, and people who 
have certain promise of development, they are going to 
examine with great care the training and past records of those 
individuals. This means, of course, that the recruitment 
divisions of municipalities, of states, and of the nation, are 
thrown directly into the same problem that we are tackling 
from the educational side in our institutions of secondary and 
higher learning. The civil service administrators and the 
personal administrators, in endeavoring to revise the condi- 
tions for entrance to a given service, sit down and say, ““This 
individual should have such-and-such, not training, but such- 
and-such courses,” because the only things they can lay their 
hands on are courses. You look through the catalogs of the 
colleges and the universities of today, and you will find that 
they have broken out in a rash of designating all their courses 
that touch the field of government as courses in administra- 
tion, although when you come to examine the content of the 
courses, you often find that it is nothing but an old wine in a 
new wineskin. The young men and young women who come 
from the courses do not actually have anything they did not 
have before, except that in filling out a civil service blank, they 
can state that they have had so many hours in the field of 
public administration. 

This means that the civil service people, many of them not 
too well informed with regard to the content of courses, many 
of them not skilled in the process of education, have been 
tempted to state educational requirements in connection with 
the development of qualifications for given examinations and 
given positions. The problem of selection based on train- 
ing is one side of the question. Another problem is the one 
of training based on the hope of selection, and you turn to 
the colleges and universities and you will find them busily 
developing courses which they think young men and young 
women ought to have to qualify them for entrance to the 
public service. Very rarely do you find the personnel admini- 
strators and the deans of our colleges and universities sitting 
down in conference to see how they can fit together the de- 
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mands from the civil service administrator’s side and the pro- 
vision of work from the educational administrator’s side. 

In this whole development that I have been tracing, we face 
several dangers. The first of these is the danger that per- 
sonnel directors will ask for too specific and too limited skills 
and training, that they will ask, as I have said a moment ago, 
for courses without knowing what the content of the courses 
is, and that they will make the mistake of assuming that a 
given skill acquired by a young man or a young woman at the 
age of twenty-one, twenty-two, or twenty-three, a given prepa- 
ration for a given specific job, is all that they need to look 
for. The whole American civil service system has grown up 
with high classification of positions. You turn to the classifi- 
cation of the city of New York, or of the state of New York, 
or of the federal government, and you will find a minute classi- 
fication, a series of pigeon-holes for individuals. The Civil 
Service Commission has endeavored to find individuals who 
will precisely fit a given pigeon-hole tomorrow, when ap- 
pointed. 

This is not what we want. We want to have the public 
service viewed as a ladder for which the Civil Service Com- 
mission seeks an individual to put on the bottom rung, or 
some other rung of that ladder, selecting him not primarily 
on the basis of his ability to fill a certain pigeon-hole or to 
step on a given rung of that ladder tomorrow, but on the 
indication that he will have the ability to go on up that ladder 
in the years to follow. That is what a career is. 

The next danger is that the schools will train for non- 
existent jobs. When Dr. Spalding and Dr. Norton and others 
were making the study of vocational education in this state 
in connection with the Regents’ Inquiry, they came upon 
more than one school system that was carefully training boys 
and girls for jobs which had disappeared—some of them ten 
years ago. You can defend such training as desirable from 
a standpoint of discipline, but it is hard to defend it in view 


of the requirements the youngsters meet when they step out 
of school. 
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There is danger that colleges and universities will do the 
same thing—train individuals for jobs in 1940 which were 
available in 1936. When the boys and girls get out, they 
will find themselves ready for the kind of work that is gone. 

There is danger that in this new situation we face there will 
be too much reliance on paper tests. We all know, particu- 
larly those of us who are interested in testing programs, that 
there are limits to the testing programs. We know that it 
is easy to administer tests if you utilize written examinations 
and written papers as a means of getting at the comparative 
capacities of individuals. The administrator can score me- 
chanically if it is a well-prepared test, and can produce a 
mathematical tabulation in which no one can charge favorit- 
ism. 

The great correctives for too much emphasis on paper 
examinations are, first, to obtain records of the past career of 
the individual drawn from the institutions with which he has 
been connected and second, to see that the original appoint- 
ment is always regarded for the first year, two years, three 
years, as part of the testing of the individual. 

Another danger we face is the failure to work out the prob- 
lem together, between the educational institutions and the 
educational administrators on the one hand, and the civil 
service and personnel officials and personnel administrators 
on the other. Together they need to analyze the problem. 
Together they need to develop integration of courses with 
training. Above all, the educational groups need to step for- 
ward to cooperate with the public officers and public employees 
in the solution of this problem. 

Educators in America, because of the known blackness of 
American politics over the past generations, have tended to 
keep their skirts clean of all politics by having nothing to do 
with government, by criticizing government, by standing out- 
side, by demanding separate budgets, separate laws, separate 
boards of control, separate everything. In the main, this 
attitude has been justified in the past, but the time has now 
come when educators, having built these walls to segregate 
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themselves from the dirtiness of American politics, have got 
to step forward and take the initiative in building a few high- 
ways through these walls. There must be cooperation in 
dealing with problems which are mutual. 

Those who run our schools cannot afford to have the edu- 
cational courses dictated by personnel officers who are not 
trained in education. But this will happen unless they step 
forward and participate in the effort to define the civil service 
educational requirements so that they recognize the best and 
most modern thinking in fields of education. 

There is another field in which we need cooperation. That 
is in the development of tests and in experimental programs 
with reference to tests. This is a field which is of particular 
significance to you in this organization in the work that lies 
ahead. 

What I have endeavored to say today is that there has 
been creeping up on us in the United States a totally new 
situation in which we have a vastly expanded public service. 
This vastly expanded public service is gradually being placed 
on a merit basis. This means the utilization of training as 
one of the important factors in the selection of personnel. 
It is now no longer possible for the educational institutions 
to go ahead on their own, training individuals for life and 
work, while at the same time public personnel officers go ahead 
on their own, selecting people on the basis of training. The 
two must get together. 

I venture the suggestion, in conclusion, that in view of the 
past policy of isolation of American education, the first steps 
in bringing about a cooperative enterprise for interrelating 
training and selection must come from the educational side. 





The Present Status of Personality 
Trait Tests 


By ROBERT G. BERNREUTER 


HE general topic of personality is an interesting one to 

all of uss When Dr. Wood asked me to talk to you 

about it, he told me that for years you have been 
discussing ability testing programs, and have excellent back- 
grounds in that particular phase of the testing program. Dr. 
Wood did say, however, that there has been much less atten- 
tion given to testing in the field of personality among the 
members of this group. I shall try to give you a broad intro- 
duction to the general field. 

For working purposes, let us accept this definition: One’s 
personality depends upon the effect that he has upon the 
people with whom he is associated. My personality during 
the next hour will depend upon the way I affect you people. 

If an individual has the sort of personality that enables 
him to come into a group of people, remain for a while, and 
then leave without anyone’s noticing that he has been there, 
we might say that he has a very weak personality. If, how- 
ever, he is always noticed wherever he goes and is one of those 
individuals whose personality pervades the whole atmosphere 
when he comes into a room, we would probably say that he 
has a strong personality. If he affects his associates pleasantly, 
we would say that he has a strong, pleasant personality. If 
the effect is one that upsets them, we would say that he has a 
decidedly unpleasant personality, though certainly a strong 
one. One’s personality, in other words, depends upon the 
inner feelings of the people with whom he associates. 

This definition still leaves a great many questions unanswered 
for us. What is there about a person that determines the way 
he affects his associates? Instead of there being some mys- 
terious, unitary characteristic that is unknowable, I believe 
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that the things which determine the effect one individual has 
upon others are the observable things. Anything that you 
notice about your associates will determine in part the per- 
sonalities of those associates. 

I cannot possibly inventory for you all of the outstanding 
characteristics, to say nothing of the more detailed character- 
istics, that are of great importance in determining the influence 
of one individual upon another, but I shall very briefly go over 
some of the things that undoubtedly are of major importance. 
Certainly one’s physique plays a part in determining how he 
affects others. In the glorious days of Athens, some of the 
judges heard testimony for and against a defendant only in 
the dark, so they would not be influenced by the personal 
beauty or lack of personal beauty of the person giving infor- 
mation. They felt that it was not possible for them to do 
justice when they were influenced by the personal beauty of 
the givers of the testimony. 

I know from my own experience in dealing with college 
students that if a girl is asked to go on a “blind” date, she is 
very apt to ask if the young man is tall, dark, and handsome. 
As we grow older and get beyond the sophomoric stage, we 
are apt to put a little less importance on the physique. I know 
a number of women, married to short, blond, and dumpy indi- 
viduals, who nevertheless seem to be happy. 

Intelligence is another one of the characteristics. Our re- 
action to the very bright individual is quite different than to 
the duller individual. Research on the choice of associates 
of first-grade children indicates that children tend to choose 
as their playmates other children who are their equals in intel- 
lectual development. If you were to ask the first-graders to 
rank their classmates in the order of intellectual development, 
they would not know what you were talking about. But they 
know that they get most fun from playing with others who 
are their intellectual equals. 

The knowledge and the skills of an individual will, in many 
instances, determine the effect he has on others. We used to 
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read advertisements about improving our personalities by 
learning to play the piano or developing some other skills. 
The trend of the advertising seems to be changing now. We 
hear more about B. O. and halitosis now, but knowledge and 
skills are still of significance. 

One’s emotional characteristics certainly play a part, also, 
in determining how an individual affects his associates. We 
react quite differently to a person who seems to have himself 
well in hand emotionally than to a person who is jittery and 
ill at ease. 

A while ago I had occasion to meet a man who has the title 
of “‘safety engineer” for a large industrial plant. He was a 
man who seemed to be of some importance around the plant, 
and yet his duties carried very slight responsibility. As we got 
acquainted, he said that he wanted to tell me his life history. 
He said, “I'd like to draw you a picture of myself.” 

He got a piece of paper and drew a base line on it, started 
at one end of the base line, and said, “‘I started down here. 
I didn’t have the advantages of a college education that some 
of you fellows had. I was a self-made man. I went up and up 
until I think you would have called me a successful man.” He 
was personnel manager of that plant, which employed five 
thousand persons. He then said, “‘After I got up there, I came 
down and down again, until now I am back where I started.” 

When he told me that story, I was curious to know why 
he had regressed from that peak of influence. It seems that 
they had had some very serious labor difficulties in that par- 
ticular plant, and a strike was called. In his position as 
personnel manager it was necessary for him to go out to the 
gates and stand in front of five thousand milling, angry men 
and try to placate them and get their cooperation. He went 
to pieces emotionally. He did not have sufficient control of 
his emotions to bear that responsibility, and it was necessary 
for the management to take away from him the authority 
they had vested in him. 

I am sure that any one of you could duplicate that story, 
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because all of us have clearly before us and in our memories 
the pictures of men and women who are failures in life because 
they do not have the degree of emotional control called for 
in their particular niches in life. 

One’s sociability, the attitude that one has toward other 
people, also plays a part. There are some lone wolves who 
really do not care much about the companionship of other 
people and almost invariably they do not have many close 
friends. There are other individuals who definitely need friends 
and the companionship of other people. As a general rule, I 
think we prefer to be with people who show us that they like 
our company; but if a person needs our companionship too 
much, he becomes a drag upon us. 

It is very common in any dormitory to have one or two 
students who never can stay in their own rooms. They must 
always be in the rooms of other people, always interfering 
with their work, always seeking and needing companionship. 
That occasionally causes great dislike for the individual. 

I want to mention only one other thing. There is no one 
who does not occasionally fail to get what he wants out of life. 
All of us are thwarted in part in having our ambitions fulfilled, 
and the way we react habitually when we face thwarting plays 
a great part in determining how we affect the people with 
whom we associate. If we rationalize, if we offer an alibi, if 
we project the blame to individuals other than ourselves, if we 
retreat from reality and withdraw within ourselves, we are 
demonstrating characteristics that are bound to have an effect. 

This list is endless. Any characteristic that a person has 
that is noticed by his associates plays a part in determining 
the effect that his personality will have upon his associates. 

Here is the next thing. One’s personality depends not alone 
on his characteristics, but depends also upon the people with 
whom he associates. If you happen to be in a beer parlor on 
Saturday evening, there may very well be a person in the crowd 
who is the life of the party. The songs he sings and the stories 
he tells make everybody feel fine. If on Wednesday evening 
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you give the same people the same amount of beer, and get 
him to tell the same stories and sing exactly the same songs 
at a Wednesday evening prayer group, the way he affects his 
associates will be very different. He will not have changed at 
all, but the associates who are being influenced by his charac- 
teristics will have changed, and, as a consequence, his person- 
ality will be modified. 

Let us go on to the matter of tests for personality. So far 
as I know, no genuis has yet been able to make a perfect test 
of personality, nor one that even approximates being a perfect 
test of personality. Before a test could be perfect, accord- 
ing to the definition just given, it would be necessary for that 
test to predict how a person would influence any group of per- 
sons. Furthermore, it would have to go beyond that and be 
a diagnostic instrument which would disclose the particular 
characteristics of the individual that were of major importance 
in determining the particular effect he has for each group of 
individuals. 

That is a large order for any test constructor to fill: a diag- 
nostic test that would include the characteristics that a person 
possesses, plus a more generalized scoring which would enable 
one to know how the totality of the person would affect any 
group of individuals. There is no such test on the market. 
There is no such test in preparation, so far as I know. 

So let me confess to you that, if you are hoping to start a 
personality testing program which will be complete, you had 
better wait a number of years. As a matter of fact, those per- 
sons who have been working on personality trait tests have 
had a very much smaller ambition. Most of them have limited 
themselves to an attempt to measure adequately some of the 
more important characteristics that determine the effect that 
one individual will have upon others. 

In the broad meaning of the term “‘personality” used here, 
any test that is a test of a person’s characteristics would be a 
test of personality. A pair of scales that tells you how heavy 
a person is would, in the broad sense, be a personality trait 
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test. An intelligence test, and any measure of personal hand- 
someness, and any school achievement test would also be a 
personality trait test. 

In the narrower sense of the word, however, those are not 
called personality tests. The so-called personality trait tests 
are limited to those tests which are concerned either with the 
personal emotionality, or sociability, or reactions to thwart- 
ings or to similar traits. 

For instance, the Adjustment Inventory, prepared by Hugh 
Bell, is concerned with the personal and social adjustment of 
the individual. Dr. Link’s Personal Quotient Test is a similar 
device. It is a test which shows the degree of introversion or 
extroversion in general as well as specific areas. There are 
also available other tests which concern themselves with a 
single trait, and which disclose the expression of that particu- 
lar trait in various areas. 

Another type of test that has been prepared is one that 
attempts to measure more than a single trait. The so-called 
Personality Inventory devised by the present speaker is one 
of these. It is an attempt to measure simultaneously such 
things as emotional stability, self-sufficiency, and dominance- 
submission. 

The test prepared by Guilford at the University of Ne- 
braska, the so-called Nebraska Personality Schedule, and the 
test prepared by Stagner when he was at the University of 
Wisconsin are other examples of tests that attempt to measure 
more than a single trait at one time. 

The number of these tests which are developed sufficiently 
to be useful is rather great, and I cannot hope to inventory all 
of them for you. It might be of some help to some of you, 
however, to know what I consider to be the best single source 
of information about the specific tests. It is the volume that 
has been prepared by Oscar Buros, and published by the Rut- 
gers University Press, under the title, 1938 Mental Measure- 
ments Yearbook. Buros has set for himself the task of getting 
experts in various fields to evaluate the more recent tests in 
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all fields of testing, and I know of no other source that will 
give you so much information about the personality tests now 
available. 

I should like to say a bit about what you may expect if you 
are to use personality trait tests in a testing program. To my 
way of thinking, there are some things one definitely cannot 
do. I do not think you can use personality trait tests in a 
selection program very well. If you are responsible for select- 
ing individuals for jobs, I think that you will get very little 
benefit from personality trait tests as they are now devised. 
The reason is that most of the tests depend upon the complete 
cooperation of the individual; and practically every test of 
which I am aware is in a form that enables an individual to 
give you inaccurate information, if it is to his benefit to do so. 
If you need the kind of information about the personality of 
an individual which will be to his detriment, you had better 
not try to use the present-day tests because almost all of them 
can be influenced by the person taking the test. We are doing 
a little work at Pennsylvania State College now which we hope 
eventually will overcome that shortcoming; but it is not an 
easy job, and it will be quite some time before such tests are 
generally available. 

If your job is that of guidance, I think you can expect to get 
more help from the tests. I think this is true whether your 
guidance is concerned with an individual or whether your guid- 
ance is concerned with the institution with which you are 
associated. 

It is our own experience at our institution that we get a con- 
siderable amount of help out of the use of instruments of this 
sort because we have come to realize that our judgment is 
definitely fallible. We need to have an objective means of 
checking our impressions of the persons who come to us for 
guidance. All of our methods at the present time in the field 
of personality are based on observation. There is probably no 
better way of knowing what the personality of an individual 
is than by complete observation of the individual and of the 
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persons with whom the individual is associated, but one cannot 
possibly observe the person whom he must guide every moment 
of his life. It is quite true that the use of cumulative records 
helps a great deal, and if your school has a working cumula- 
tive record system, you will find that it will enable you to 
make better personality judgments than will be possible with- 
out such a system. 

We find such things as this: A person comes in and has 
difficulty in adjusting himself to the social situation at the 
school. Our first impression is that we are dealing with an 
individual who does not care for friends. His history is that 
of a person who has always been a fairly solitary individual. 
However, the questions that he answers concerning himself 
indicate that despite the fact he has lived a solitary life, he 
has a definite need for companionship, and the reason he has 
been by himself is largely the fact that he is a shy individual 
who is easily embarrassed. In order to protect himself from 
embarrassment, he has developed a set of habits that are 
interpreted by others as meaning that he does not want 
friends. 

When we just sit down and talk to a person casually, we 
find that it is difficult to distinguish between the person who 
really does not care whether he has friends or not and the 
other person who has a great need for friends but will not 
permit himself to take the initiative in social situations 
because of his shyness. If we use personality inventory type 
tests, we are able to get information that gives us more 
insight into the individual. But again, we must make sure 
that the relationship between ourselves and the person who 
is being examined is such that he will cooperate with us. 

One boy came to our clinic for advice, and we started to 


give him a personality inventory. He said, “I took one of 
these last week.” 


““‘Where ?”’ 


‘“‘A professor in my psychology class gave me one.” 
I said, “In that case, you will not need to take this. If 
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it is all right with you, I will ask him to let us have that 
one and it will save you the trouble of taking the test again, 
and it will save us the trouble of rescoring it.” 

The boy hesitated and said, “I think you had better give 
it to me. I don’t like that professor. I don’t want him to 
know what I’m like, and I didn’t tell him the truth on that 
test. However, if you will give me one now, I will tell you 
the truth.” 

It will always be necessary to develop rapport with the 
people with whom you are working, so they will have suf- 
ficient confidence in you to disclose the way they really feel. 

Another instance of the use that we find for tests of this 
sort is this: Last week a girl who was tremendously afraid 
of her chemistry came to our clinic. She has not been able 
to digest her food on days when she had to go to her 
chemistry class. ‘That is a serious symptom, is it not? If 
we had a psychiatrist in our institution, we would turn that 
case over to the psychiatrist without thinking twice about it. 
Unfortunately, we do not have a psychiatrist and we must 
go along as best we can. 

My first impression was that here we were dealing with 
a girl who was generally easily upset. I thought that we 
were working with a girl who was a neurotic individual, who 
would have a great many symptoms. If she did not have 
this symptom, she would probably have another symptom. 
We asked her to fill out the personality inventory, and it 
turned out that she had a score that indicated that her degree 
of emotional stability in general was no different from that 
of a relatively normal individual. 

Then we were faced with a very difficult situation. The 
test said she was a relatively normal individual. The ex- 
perience in her chemistry class indicated that she was any- 
thing but a normal individual. Upon further investigation, 
we found that both were true. The girl had shown very, very 
few emotional symptoms of an unstable nature, except in 
the chemistry situation. We were dealing with a highly 
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specific symptom that was an isolated instance of emotional 
instability, and our way of handling that case, as a conse- 
quence, was quite different than it would have been if we 
were dealing with a girl who was generally unstable. 

The same week, there came to our clinic a young man who 
was also being upset by the fact that he was not having a 
very great degree of success in his classes. The personality 
inventory indicated to us that this was not an isolated symp- 
tom at all—that dozens and dozens of things would upset 
him, that he was a person who, in almost any situation, was 
apt to go to pieces. 

Our treatment of those two individuals is different, and it 
is different because of the supplementary information that we 
got about them as a result of the use of reasonably objective 
personality trait devices. Highly skilled individuals might 
have been able to determine the differences in those two 
individuals simply by an interview technique, but I personally 
am not able to do that, though I have had quite a few years 
of work in the field. Our graduate students in training for 
school psychologists have not enough experience to do that 
either, and it is necessary, we feel, for us to check our judg- 
ment by the use of more objective methods. It is a fairly 
common experience for us to find that some of the most able 
students at the college have the least confidence in themselves. 
You know such people: people who are extremely brilliant 
but who have not been able to convince themselves of that 
fact. We have worked out a little device that enables us to 
get started on the matter of building up confidence in those 
individuals and it seems to work out fairly well. It gets us 
started only. It does not take us beyond that point, but it 
works to that extent at least. 

In our vocational guidance clinic, we give a battery of ability 
tests and personality trait tests. We make out profiles show- 
ing the test scores, and then we sit down with the individuals 
and show them the results of their tests. Quite frequently we 
find that all the ability scores for a certain student fall on 
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the right-hand margin of the sheet where the high scores are 
shown, whereas all of the personality trait scores fall on the 
left-hand side of the sheet, which indicates that the person 
has little or no stability, or self-sufficiency, or dominance. We 
point out to the student the contrast and show him that he is 
brighter than he believes he is, and that people will take his 
opinion as being sound more quickly than he will accept his 
Own opinion as being sound. 

It is easy enough to tell that to the student, but it is far 
more effective to be able to put it down quantitatively in such 
a way that the student can begin to convince himself—not as a 
result of any argument you give him, but as a result of what 
he can see numerically expressed—that he deserves to think 
of himself as a first-rate instead of a third-rate person. 

I want to take just a moment to point out to you at least 
one instance in which an institution was guided in its own 
policies by the use of personality trait tests. A study was 
made in a private institution, an academy and junior college 
out on the West Coast. This institution is one that gets a 
very superior quality student. It draws its students from the 
upper economic and social classes on the West Coast. Accord- 
ing to the catalog of the institution its avowed purpose is to 
train leaders, and the quality of student material sent to the 
school without doubt should enable the institution to turn out 
leaders. They have all the economic and social advantages 
for which students could possibly ask. 

At this institution the professors were asked to pick out 
students who they felt were the sort that the school ought to 
develop. The professors did that, and those students were 
given personality trait tests. The students preferred by the 
professors at this institution (which was intended to train 
leaders) were those with less than average emotional stability. 
They were less self-sufficient than the average, and more sub- 
missive than the average. That may sound to you like the 
picture of a leader, but it does not to me! 

As a result of that study, I am convinced that that institu- 
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tion was all mixed up in its objectives. It wanted to train 
leaders, but at the same time it wanted to have around boys 
who were nice, namby-pamby individuals who did not make the 
teaching job too hard for the teachers. Your institution may 
want to train leaders and it may be willing to put up with boys 
who are potential leaders, but if so, it is different from that 
West Coast institution. 

I am sure that ingenious personnel directors or head mas- 
ters could find a good many other uses for personality trait 
tests which would enable them to evaluate reasonably objec- 
tively the programs that they have instituted, that they hope 
are training the personality traits they want their students to 
develop; but without research and without the use of person- 
ality tests in research I do not think a person can be very sure 
of his program. No one should begin to use tests with the 
belief that they will answer all questions about the develop- 
ment of the personality of individuals, but it is my conviction 
that some help and, occasionally, crucial help can be obtained 
even with the use of our present imperfect instruments, if they 
are added to a testing program. 











Parents and Cumulative Records 
By ROBERT N. HILKERT 


OR a long time now, those of us who have attended 

these annual meetings have been convinced of the great 

value of cumulative records. Many of us, for nearly a 
decade, have been laboriously entering upon complicated cards 
all sorts of complex data, this to the end that we shall be able 
better to understand and to guide our students. There is not 
the least doubt that the modern instrument of guidance known 
as the cumulative record card is fulfilling many of the hopes 
that were held for it by the early crusaders in the field of 
personnel study. 

The question ought now be asked, “For whom have we been 
gathering all these data?” It is appropriate to ask also, ““Who 
is it that is supposed to learn about these students?’ Let us 
ask these questions of the first half-dozen personnel officers we 
encounter, and record the answers. Among the replies we may 
be sure to find for tabulation the following: headmasters, 
deans and registrars, college admissions officers, teachers, and 
even the students themselves. It is strange that so few have 
made even passing mention of the group of people known as 
parents. Why should they be forgotten? 

The maintenance of cumulative records is expensive. At 
least, this point has often been raised by some who have not 
yet found it possible to engage in the time- and energy-con- 
suming procedures that must be followed. The records are 
expensive, especially when we include, as we must, the cost of 
tests and the scoring and reporting services. Who pays for 
all this? 

We personnel officers, particularly those of us in the inde- 
pendent preparatory schools, are likely to forget that we 
should probably have no modern cumulative records if par- 
ents were not willing to produce the funds necessary for their 
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maintenance. It is a curious fact, but one with which most 
taxpayers are familiar, that those who really pay the bills 
are apparently forgotten in the rendering of the full itemized 
account, if such actually does exist. It is true that parents are 
beginning to learn that schools are engaging in testing pro- 
grams. They are finding it out through the documents known 
as term-end, or end-of-semester, bills. Some of these parents 
are becoming curious about this item designated merely as 
“tests.” Perhaps it is only because they are mildly interested 
in where their money is going. This may be a curious approach 
to the more important theme of this paper, but it is not an 
idle one, as anyone who understands parents will testify if he 
is entirely honest. 

It is here contended that there is a fuller account that 
should be rendered to the parents, if for no other reason than 
that they are paying for a service that should benefit them 
directly. Jt is the full account of the cumulative record itself. 
This should include the service of expert interpretation, and 
under no circumstances should the account be rendered with- 
out this service. 

Let us now forget the quid pro quo aspects of the topic. 
We must ask ourselves a question of far greater import. It 
is this: “Of all people, who have the greatest right to know 
all that we know about a student?’ Are they headmasters 
and college admissions officers? Those of us who are parents 
do not agree. We are the ones who have the deepest interest, 
an interest that is cumulative over a period lasting a full life- 
time. We are the ones who have the greatest right to know 
about our children. 

We who are the professional educators know that our best 
work is done when we have a genuine interest in all those 
whom we attempt to guide. We also know, and will confess 
it in our more honest moments, that it is difficult to become 
really interested in the welfare of every student. This is be- 
cause we are subject to human failings. We cannot forget, 
however, that every student does lay claim to a few persons 
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who are very deeply interested in him, and who are highly 
concerned with his welfare. Heading the list are his parents. 
To be sure, we occasionally encounter parents who appear to 
have no real interest in their own children, but they are excep- 
tional and probably must be classified as “problem parents.”’ 
There are those who consider all parents as problems. Little 
is gained by our assuming this sort of facetious attitude. 

Does there exist any schoolmaster who at one time or an- 
other has not made the remark, “I know this youngster better 
than his parents know him’? This is usually said with an air 
of omniscience. It carries with it the ring of finality. What 
is true is that the schoolmaster does know some things about 
the student that are unknown to the parents. It is a poor 
teacher indeed who is unable to make some discoveries. The 
real point is that these discoveries should be made known to 
those who have the greatest right to know about them. It 
is for us to share our knowledge with the parents. Not to do 
so is to evade one of our most important responsibilities as 
teachers of other people’s children. 

If we know the student, and the parents come to know him 
as we do, are we not then in a fortunately excellent position 
to do the kind of guidance that we really want to do? Guid- 
ance is destined to be ineffective where there is a lack of 
mutual understanding between the school and the home. Of 
course, it is assumed that we do help the student to understand 
himself in the light of his own strengths and weaknesses. Fail- 
ing that, we have no guidance at all. 

It is one of the aims of education to develop within each 
student a competency in the making of choices. Among the 
choices that must be made are those involving selection of 
courses, the selection of a college, and the choice of vocation. 
There are many others, but those are an important few. It 
requires no argument to point out the value of cumulative 
records in aiding one to make choices in a wiser fashion than 
they might otherwise be made. We have heard this line of 
talk repeated over and over again. It sounds well. We need 
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to pause for a moment and ask ourselves, ‘“‘Who is this one 
that really is to make all these choices?” 

Are there among us those who are so blinded to the ordi- 
nary facts of the scheme of things that we fail to realize that, 
in general, our students are not free agents in making all the 
important decisions that must be made? Let us not argue 
whether they should or should not be free agents. Let us 
think only of the fact that they are not. It simply isn’t true 
that our students select their colleges apart from the judg- 
ments of their parents. In the selection of courses our students 
are influenced by the beliefs of parents. In rare instances does 
the student arrive at the choice of his vocation entirely un- 
influenced by father and mother. Those who believe that 
students are free and independent do not have a very keen 
insight into the nature of the parental mind, and they are most 
certainly not observant. We all know that this parental influ- 
ence exists, but we often proceed in our techniques as though 
it does not exist. 

A guidance counselor is often able to help a student make 
for himself wise choices. What, all too often, is the result 
when this student informs his parents of these choices? Do 
they sit back and gaze upon their offspring with splendid de- 
tachment? Do they submit willingly and assume an attitude 
that it is well for son to make his own decisions, since it is he, 
after all, who must live his own life? Do they approve of the 
youngster’s plan for his future, knowing that it must be good; 
for after all, he has discussed it with a guidance counselor at 
his school ? 

Everyone knows that parents are not so isolated from the 
lives of their children. They are not going to have their hopes, 
plans, and aspirations thwarted merely because the school 
happens to have on the staff someone called a guidance coun- 
selor, and who happens to have ideas at variance with theirs. 

No personnel officer in a preparatory school has escaped 
the enlightening experience of trying to tell an old Princeton 
man that his boy, in the light of his nature, ought to go to 
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Harvard. Or, try to tell the same man that his boy will be 
better off by not going to college at all! We all know the old 
Yale man who told his son that it really made no difference to 
him where he went to college, but that if he chose Yale he 
would pay his way for him. Are these experiences unfamiliar? 
Parents have ideas. When we advise action contrary to these 
ideas the parents do not take it lying down. Parents must be 
convinced that the school’s advice is sound advice. 

Decisions of any importance ought to be made only upon 
the basis of tangible evidence. What makes us believe that we 
can swing parents around to any sort of opinion merely be- 
cause we engage in the usual run of verbal generalities? We 
come forth with conclusions, and we too seldom dwell at sufh- 
cient length on the exact reasons for our conclusions. We may 
say that we do have evidence for our opinions. The wise par- 
ent, and there are many of them, replies, “All right, permit 
me to see it.” And when he says “see it”? he means exactly 
what he says. 

Recorded upon our cumulative record cards are some of the 
data used in evaluating the abilities and the achievements of 
our students. It is here advocated that this is the evidence 
which should be shown and expertly interpreted to the stu- 
dent’s parents. This means all of the evidence, not part of it; 
and it means in original form, not in reduced verbal summary. 
It does not mean, of course, that we should make photostatic 
copies of cumulative record cards and send these copies by 
mail to the parents. Expert interpretation can be made only 
by means of the personal interview. 

The consultation, in some ways, is comparable to that tak- 
ing place in the physician’s office. True the physician does not 
cite to the patient all the objective evidence of examination, 
nor does he depend entirely upon measurement in making final 
diagnosis. In general, it is true that the patient’s history en- 
ters into the discussion and the results of measurement are 
recounted whenever the doctor feels that something is gained 

by so doing. Most of the better physicians do explain the 
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evidence for their conclusions to the patient. People, more- 
over, have faith in the family physician. They are often will- 
ing to take his word without elaborate explanation. A similar 
faith in educators has not yet been attained, and it is not likely 
to be realized in the near future. From us is wanted not 
only a judgment, but the evidence for the conclusions we have 
drawn. To give opinions without evidence for them places us 
in a weak position. 

It is enlightening to think of the technique used by the 
school physician whenever he must make a decision of a seri- 
ous nature affecting a student. How far does he go without 
referring to that student’s parents? Most school physicians 
keep the parents fully informed of the student’s health status. 
It is the academic end of the school that keeps parents in the 
dark. 

Opinions that we may have about a student must, when 
stated to parents, produce some changes in their own think- 
ing. The most effective way of aiding them is to lay our cards 
on the table in plain sight. (For once this expression is not 
used in its figurative sense.) It is not professional to try to 
change the thinking of parents through vague generalizations 
or through imposition of authority, an authority not always 
recognized by parents. This is particularly true when our 
own views and those of the parents are not coincident. 

In recommending that the cards themselves be shown to 
parents, the writer recognizes that objections will be made. 
In his own experience they have been made. We must con- 
sider a few of these objections. 

It has been said that our cumulative record cards are too 
complex in character, especially if the graphic or “‘grid’”’ form 
is used. Such cards are not comprehensible to parents. This 
objection is usually offered by those who have had difficulty in 
making the card comprehensible to teachers. Until some Ph.D. 
candidate makes a study proving that the parents of prepara- 
tory school students are more difficult to teach than are the 
teachers of those students, the objection cannot be considered 
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valid. Some parents are a little slow on the trigger, but there 
are some teachers who are none too fast. 

The only teachers who cannot understand the modern cumu- 
lative record cards are those who are not sufficiently interested 
to learn. Parents are different. One card in the file is of im- 
mense importance to one father and to one mother. They will 
make every possible effort to understand everything that is 
recorded on that card. If the personnel officer is worth his 
salt he will have little trouble in making his recorded evidence 
intelligible to most parents. If he experiences difficulty at 
every turn, then the card he is using may be too complex and 
should be scrapped. But before doing that the school should 
be on the watch for a better man for the job. 

At this point I should like to digress for a moment to hurl 
a very small dart at the education departments of the univer- 
sities that profess to train men to become guidance counselors 
and personnel officers. What kind of training do these men 
receive? They are put through their statistical paces. They 
become highly skilled in calculating probable errors and stand- 
ard deviations. They investigate the theory of probability and 
the method of factor analysis, whatever that may be. They 
learn how to make studies which they report in a language 
that can be understood only by the gifted few. In all this 
maze of intellectual barbed wire it seldom occurs to anyone 
that a personnel officer must, first of all, know how to deal 
with people tactfully and sympathetically. Most of the people 
he meets are parents. His most difficult job is not at the calcu- 
lating machine; it is at his desk facing a couple of parents on 
the opposite side—parents who may be in any state of recep- 
tivity from pure docility to blind intransigence. It is in these 
interviews that the personnel man sinks or swims. In their 
discussions of “‘job analyses” let the professors begin not with 
law, medicine, or engineering. Let them first examine the con- 
ditions nearer to the home plate. We may look forward then 
to personnel officers who can make cumulative record cards 
understandable to parents, and possibly even to teachers. 
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Another objection to the proposal that cumulative record 
cards be shown to parents is that in many cases “the parents 
are likely to become too discouraged, especially when the 
youngster has measured none too high in certain fundamental 
qualities.” This is hardly sufficient reason for covering up the 
truth. Parents are made of stronger stuff than many of us 
believe. They cannot raise children to adulthood without 
meeting discouragement in more ways than one. It cannot be 
denied that the child who appears not to be “making good” 
in school does often cause the personnel officer to engage in 
difficult and delicate interviewing of parents. A difficult situa- 
tion, it must be remembered, is no excuse for lack of candor 
or for inaccurate portrayal of the facts through skillful indi- 
rection. A personnel officer must be tactful, he must be diplo- 
matic, he must be kindly; but he cannot be dishonest. Our 
schools and our faculties have something to learn in the mat- 
ter of the use of simple honesty in dealing with parents. 

It is in the areas of the student’s weaknesses that parents 
should be certain to have a firsthand inspection of the evi- 
dence. We have no trouble in having parents believe us when 
we inform them that their child is a highly capable person in 
many fields. Parents are less ready to believe us when we 
start talking about deficiencies. A careful inspection of the 
evidence recorded in graphic form, and a meticulous interpre- 
tation of the record by the personnel officer constitutes the 
most effective way of arriving at mutual understanding. 

It is the duty of the counselor scrupulously to explain what 
scores really mean. No one has a right to be a counselor until 
he is well grounded in his knowledge of test limitations. We 
are all guilty, perhaps, of being at times too dogmatic. 
We often rely too heavily on invalid and unreliable data. 
We generalize from too few data. We attribute to tests 
values that were never originally intended for them. We at- 
tribute to them an accuracy that often does not exist. Much 
of the time we are not really sure what it is that we have 
measured, and we act as though we are sure. We know full 
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well that our tests leave many qualities that we should like to 
be able to measure entirely untouched. We know it in theory, 
but we do not always remember this in actual practice. 


It is appropriate at this particular conference to express 
gratitude to the Cooperative Test Service and to the Educa- 
tional Records Bureau because these organizations are doing 
everything within their power to keep personnel officers from 
erring in all the directions that have been mentioned. For ex- 
ample, from the Cooperative Test Service have come “scaled 
scores” which have made possible comparability between tests 
in different subjects. On the Cooperative Test Service scoring 
keys we find, indicated in graphic form, the standard errors of 
scores, not only at the mean, but above and below the mean. 
Those of us who use the Cooperative Tests and also the serv- 
ices of the Educational Records Bureau realize the value of 
having at our disposal such a great variety of representative 
and reliable norms. All these things enable us to interpret 
cumulative records more fully, and with a greater feeling of 
security than would be possible with other tests. The service 
which is rendered day after day throughout the year by the 
Educational Records Bureau, particularly the help that is 
given to us in the correct interpretation of data, is a service 
that is invaluable to us, the workers in the field. It is fitting 
that the writer give expression of gratitude to Dr. Flanagan 
of the Cooperative Test Service and to Dr. Traxler of the 
Educational Records Bureau, not merely because of the serv- 
ices they are rendering to their own organizations, but because 


they are helping to make many of us personnel officers more 
skilled than we otherwise would be. 


Our records do furnish us with usable indices. In talking 
with parents we should make this clear to them that they are 
rough, but that they are indices nevertheless. And to tell an 
imposing story of strengths or competencies without at the 
same time disclosing weaknesses or deficiencies is to pursue a 
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“cover-up” policy, a policy that is followed by some of our 
professional vocational guidance “‘experts.’’ This is a policy 
that is hardly defensible in a personnel office that desires to 
maintain its integrity. The truth may be discouraging, but it 
would be valuable to know how much ultimate discourage- 
ment has been the result of failure to tell the truth. We may 
not know the whole truth, but that is no excuse for not telling 
as much of it as we do know. 

There are many who agree to the idea of showing and inter- 
preting the cumulative record card to parents, but only that 
part of it upon which is recorded objective evidence. There 
is another part of the card containing notes of a personal 
nature, notes that come from sources often not characterized 
by a high degree of objectivity. The point raised is that some 
of these notes are of an intimate nature and ought not be 
accessible to parents. This is difficult to understand. We ask 
again, ““Who is it that has the greatest right to know all that 
we know about the student ?”’ If the evidence is not admissible 
in a court of parents, then it probably has no right to be ‘“‘on 
the record.” We tend to forget that we are not asking the 
parents to consider all the card material as being the last word 
in ultimate truth. We are asking them only to consider with 
us certain evidence and information that may have significance 
in the understanding of an individual whom we are trying to 
help. 

The good personnel officer doesn’t overlook the fact that 
this parental interview will supply him with much information 
that he has not previously learned. In a way, many parents 
resemble the boy who has been summoned to the dean’s office 
because of his alleged connection with some disciplinary 
fracas. The boy doesn’t “open up” markedly until he ascer- 
tains how much the dean already knows. He plays cagey, 
and remains remarkably silent until he senses how things 
really stand. When parents are confronted with the kind of 
evidence we enter upon cumulative record cards, they find that 
we are like the dean who already knows much. The parents 
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then contribute more information to the situation than they 
have confided during any previous visit to the school. When 
the counselor lays his card upon the table it seems to act as 
a catalyzer for the parental reactions, and often the resulting 
truth-telling becomes quite bewildering. 

The counselor should not fail to modify his own judgments 
whenever the added information makes it wise to do so, and 
this happens more often than many people like to admit. It 
is a beautiful example of personnel psychology when the 
officer, in the presence of the parents, enters upon the card 
some important bit of information that they have con- 
tributed. This simple procedure, and wise one in the light 
of our fundamental purposes, often can have a more telling 
effect upon mutual understanding than hours of persuasive 
‘professional argument.” 

We come to another objection. It is held by some that 
parents do not really want to hear all the truth about their 
youngsters. This is a variation of the “public likes to be 
fooled” argument. There is a contention that parents like 
to have us tell them only “the nice things” about their young 
hopefuls. This may be true of some mothers and fathers. 
It leads to a technique whereby we tell them only what they 
want to hear. We soon come to have a pride in our knack 
of “getting along with people.’’ Pride, however, still 
cometh before a fall. In the long run we do not get away 
with it. The reputation of the guidance officer and the 
reputation of the school is, in the long run, dependent upon 
fair dealing with the parents. This means telling the truth, 
the whole truth—as we see it. It may be that the public likes 
to be fooled. It isn’t true that parents should be fooled. 
It would help school enrollments considerably if we all paid 
more attention to the wise remark of Lincoln having to do 
with the subject of ‘‘fooling the people.” 

There is a difficulty that must be recognized in following 
the plan here advocated. It is time consuming, particularly 
if one must start at scratch with each parent. The writer has 
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been able to overcome much, but not all, of the difficulty 
involved. He passes on his experience for whatever it may 
be worth to others. At large gatherings of parents he has 
had the opportunity of explaining the nature of cumulative 
records, the uses and limitations of tests, the more important 
features of a guidance program. Using lantern slides of case 
records it has been possible to explain to the groups the 
general principles and techniques used in the personnel 
ofice. This procedure has made it possible to save hours 
and hours of individual explanation in the interviews. It 
has been feared by some that if there was anything that might 
be likely to kill the interest and enthusiasm of any parent 
meeting it would be a talk on the “keeping of records.”” One 
would have to be sure to have a good speaker on “athletics” 
or something that could be depended upon to restore vitality 
to the suffering audience! This, of course, showed a com- 
plete lack of understanding of the nature of the parental 
mind. Each parent had one thought, “Do you have a card 
like that for my boy, and may I see it?” 

The number of interviews which followed during the 
ensuing days and weeks made clear a number of points. 

It became evident that parents can understand cumulative 
record cards. Their interest in them was almost unbeliev- 
able. They agreed that as a basis for satisfactory interview- 
ing the cumulative record card is invaluable. They showed 
that they really did want to know all that we know about 
their boys. They did contribute more information than we 
had been able to gather from them in times past. They did 
express themselves, in unmistakable terms, that no service the 
school had to offer was of greater value to them. And the 
fathers particularly were glad to understand more clearly 
just what was being done to justify one particular item on the 
end-of-term bill. 











The State Testing Leaders Meet Again 


By DONALD J. SHANK 


FTER the deluge of measurement and guidance discus- 
A sion which poured forth at the Eighth Educational Con- 
ference, as already reported in this Supplement, it seems 
difficult to believe that some individuals should choose to con- 
tinue discussion of these problems for a longer period. 
Workers in measurement are, however, serious and intensive 
persons. The Committee on Measurement and Guidance of 
the American Council on Education capitalized on these char- 
acteristics by calling in 1936 a meeting of state testing leaders 
to follow the regular sessions of the New York Educational 
Conference. The success of the original meeting has de- 
manded its continuation annually since that time. 

The conference of state testing leaders, which met this year 
in New York City on October 28, is a peculiar hybrid among 
educational bodies. It is an informal gathering of measure- 
ment technicians, supervisors of state, regional, and national 
testing programs, and test users. The conference operates 
under a casual, even impromptu, administration. It has no 
formal officers, membership, or dues. Although the confer- 
ence has been an invitational affair, the only restriction on 
guests has been designed to keep the group small enough to 
gather around one table. An opportunity for individuals to 
get acquainted and for informal discussion is the object of this 
rule. 

The following individuals attended the 1939 meeting: 


Walter V. Bingham, Stevens Institute, Hoboken, New Jersey 

Oscar K. Buros, Rutgers University, New Brunswick, New 
Jersey 

P. F. Crane, University of Maine, Orono, Maine 

A. B. Crawford, Yale University, New Haven, Connecticut 

J. R. Crawford, University of Maine, Orono, Maine 

W. J. E. Crissy, University of New Hampshire, Durham, New 
Hampshire 
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Warren Findley, New York State Department of Education, 
Albany, New York 

John C. Flanagan, Cooperative Test Service, New York City 

J. R. Gerberich, University of Connecticut, Storrs, Connecticut 

Lowell Giffin, Cooperative Test Service, New York City 

John G. Kelley, Winthrop College, Rock Hill, South Carolina 

Lucien Blair Kinney, State Normal School, Oswego, New York 

Charles R. Langmuir, Carnegie Foundation for the Advancement 
of Teaching, New York City 

E. F. Lindquist, State University of Iowa, lowa City, lowa 

H. T. Manuel, University of Texas, Austin, Texas 

Walter J. McNamara, International Business Machines Corpora- 
tion, New York City 

H. H. Remmers, Purdue University, Lafayette, Indiana 

David G. Ryans, Cooperative Test Service, New York City 

Robert S. Sackett, Motion Picture Project, American Council 
on Education 

David Segel, Office of Education, Washington, D. C. 

D. J. Shank, American Council on Education, Washington, D. C. 

John M. Stalnaker, College Entrance Examination Board, 
Princeton, New Jersey 

Eleroy L. Stromberg, Oklahoma Agricultural and Mechanical 
College, Stillwater, Oklahoma 

L. L. Thurstone, University of Chicago, Chicago, Illinois 

Herbert A. Toops, Ohio State University, Columbus, Ohio 

M. R. Trabue, Pennsylvania State College, State College, 
Pennsylvania 

Arthur E. Traxler, Educational Records Bureau, New York 
City 

Morey J. Wantman, Carnegie Foundation for the Advancement 
of Teaching, New York City 

S. W. J. Welch, University of North Carolina, Chapel Hill, 
North Carolina 

Ben D. Wood, Cooperative Test Service, New York City 

Eleanor P. Wood, Educational Records Bureau, New York City 

Ray G. Wood, State Department of Education, Columbus, Ohio 

Joseph U. Yarborough, Southern Methodist University, Dallas, 
Texas 


H. H. Remmers, Purdue University, served as chairman of 
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the planning committee and presiding officer. He opened the 
session with a brief discussion of suggestions for future meet- 
ings of the group. The following problem areas were men- 
tioned as worthy of consideration: (1) ethical implications 
of testing programs; (2) promotional problems; (3) admin- 
istrative and economic problems in testing; (4) specific sta- 
tistical or service questions. 

Joseph U. Yarborough, Southern Methodist University, 
and H. T. Manuel, University of Texas, discussed possibil- 
ities and limitations in state-wide and regional testing pro- 
grams with particular reference to the work of the Texas 
Commission on Coordination in Education. Dr. Yarborough 
pointed out that although technical progress had been made 
in evaluation, the results of student analysis are not being 
used effectively in educational practice. He suggested the 
following steps to facilitate this use: (1) encourage parents 
to take a more active part in education; (2) give special in- 
service training for teachers regarding individualized educa- 
tion and counseling and guidance technique; (3) improve the 
offerings of teacher training institutions; and (4) maintain a 
true balance between production and consumption of test re- 
sults. Dr. Manuel emphasized that the primary problems in 
testing programs were securing cooperation from participating 
schools and training administrators and teachers to use the 
data which tests reveal. He urged the development of ‘‘uni- 
versal units that will form a continuous scale or succession of 
scales each articulated to the preceding and reaching from the 
abilities of the new-born to those of superior adults.”’ Basic 
tests could then be prepared and calibrated in terms of these 
units and all authors and publishers could translate their scores 
into units of these basic tests. 

A paper with a somewhat similar objective was read by 
Herbert A. Toops, Ohio State University, who argued for a 
“standard million” in compiling norms. Utilizing the actu- 
arial concept of “standard million,’ Dr. Toops set up seven 
criteria for a group on which adequate norms might be based. 
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The population should (1) be thoroughly representative of 
the type for which the test is primarily intended; (2) be sub- 
sequently duplicable; (3) have no pronounced historical trend; 
(4) not be markedly affected by unusual circumstances such 
as wars, depressions, etc.; (5) have characteristics that ap- 
peal to the majority of test users as reasonable and sensible; 
(6) not include groups with pronounced handicaps in test 
taking; and (7) be such that the work of compiling norms 
can be minimized. On the basis of the Ohio testing program, 
Dr. Toops set up eight traits for a possible population for 
Ohio College Entrance Tests. 

Eleroy L. Stromberg, Oklahoma Agricultural and Mechan- 
ical College, and E. F. Lindquist, State University of Iowa, 
discussed the possibilities and limitations of interchange of 
test materials. Dr. Stromberg reported the experience at one 
institution where a Board on Examinations had collected all 
quizzes and examinations and subjected them to item analysis. 
Each item is recorded in a flexible file and copies sent to the 
departments involved. Dr. Lindquist pointed out that ex- 
change was not as easy between state and regional testing 
projects. He emphasized that though there were regional 
differences in objectives, content, and population, the common 
character of various programs was larger than the uncommon. 
However, the lack of information about other programs, local 
variations of strategic importance, local administrative re- 
quirements, all work against exchanges. Furthermore, de- 
centralization provides maximum opportunity for experi- 
mental development of improved techniques, encourages local 
initiative, and builds testing talent. 

The testing program of the joint committee of the National 
Office Managers Association and the Business Council of the 
Business Education Association was described by W. J. E. 
Crissy of the University of New Hampshire. It includes the 
development and use of a battery of tests to measure pro- 
ficiency and certify candidates in several commercial fields 
(typewriting, stenography, machine transcription, calculating 
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machine operation, bookkeeping, and filing) in which public 
and private schools give pre-employment training. Miniature 
vocational tests, a personality rating schedule, general in- 
formation tests, and a business fundamentals test are com- 
bined for an over-all estimate of the individual’s ability. Stu- 
dents have paid to take the tests for possible job certification. 

John M. Stalnaker, College Entrance Examination Board, 
discussed the results from recent factor analysis studies with 
particular reference to L. L. Thurstone’s Tests for Primary 
Mental Abilities. Dr. Stalnaker pointed out the present diff- 
culties in the mathematics of factor analysis in that statistical 
checks on error factors cannot be made and that there is no 
objective criterion for axes rotation. He summarized briefly 
certain intensive studies which the College Entrance Exam- 
ination Board has made of Dr. Thurstone’s experimental tests 
pointing out possible sampling errors both in the population 
used for the experiment and the test materials. He questioned 
the use of short speed tests with little or no analysis of in- 
dividual items. Dr. Thurstone, in the discussion, emphasized 
the experimental nature of the present battery and urged 
further research by other measurement workers. 

The system of Scaled Scores, which the Cooperative Test 
Service is now furnishing for its various examinations, was 
discussed by John C. Flanagan, associate director. The re- 
sults of Dr. Flanagan’s study were published by the Coopera- 
tive Test Service in December.’ The basic units were ob- 
tained by “‘a rational scale system, the essential element of 
which is the derivation of units which tend to make the dis- 
tribution of the test scores obtained by students in a single 
grade, studying a particular subject, in a single school system, 
approximately normal.” 


Walter J. McNamara read a paper prepared by E. C. 


1 John C. Flanagan, The Cooperative Achievement Tests: A Bulletin Report- 
ing the Basic Principles and Procedures Used in the Development of Their 
System of Scaled Scores (New York: Cooperative Test Service, December 
1939), 25¢. 
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Schroedel of the International Business Machines Corpora- 
tion, advising the conference that seventy-five of the test scor- 
ing machines were now available. The new item analysis unit 
will soon be in production and should expedite research on 
tests. 

This brief summary of the testing leaders conference can 
only indicate the quality and scope of the problems which 
were discussed. All the papers read at the meeting have been 
mimeographed by the American Council on Education and 
can be obtained at cost by writing to the author of this report. 
Because the group was a small one, the freedom to ask ques- 
tions facilitated the exchange of opinions and ideas. For 
those who attended the 1939 meeting, the time was well spent. 
In adjourning the group took one of its few formal actions. 
It voted to express its thanks to the Committee on Measure- 
ment and Guidance for making possible the conference; to 
meet again next year; and to ask E. F. Lindquist to serve as 
chairman of a planning committee for the 1940 session. 


Ninth Annual Meeting of Institutional 
Members of the Educational Records 
Bureau: Committee Reports 


COMMITTEE ON TESTS AND MEASUREMENTS 
John A. Lester, Chairman 


Members 


Ronald S. Beasley, Groton School 

Emilie C. Bradbury, Germantown Friends School 
*Rosa Davis, The Brearley School 

Walter F. Dearborn, Harvard University 
*Howard V. Funk, Bronxville Public Schools 

Donald W. Goodrich, Calvert School 

*E. D. Grizzell, University of Pennsylvania 

John A. Lester, Friends Council on Education 

A. L. Lincoln, The Lawrenceville School 

Richard H. McFeely, George School 

Amy L. Philips, Lincoln School 

Chester F. Protheroe, The Beaver Country Day School 

Frank S. Somerby, The Buckley School 

Arthur E. Traxler, Educational Records Bureau 
*Howard R. Williams, Western Reserve Academy 
Della E. Wood, Radnor Township Schools 


Guests 
John C. Flanagan, Cooperative Test Service 
Robert N. Hilkert, The Hill School 
Thomas F. Morrison, Milton Academy 
Margaret Seder, Educational Records Bureau 


Ben D. Wood, Cooperative Test Service and Educational Records 
Bureau 


The first item on the agenda was a report by Dr. Lincoln 
on the work of the Subcommittee on Test Selection, of which 
he was chairman. He reviewed briefly the minutes of the 
two meetings which the subcommittee held during the pre- 


ceding year to choose the tests for the spring, 1939, and fall, 
1939, testing programs. 


* Unable to attend. 
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The next item of business was concerned with reports of 
the chairmen of the Subcommittees on Test Construction. 
Dr. Flanagan reported the work of the Committee on Mathe- 
matics Tests. He passed out an article prepared by Dr. 
Seder in which data on the new Mathematics Test for Grades 
7, 8, and 9 were reported. Dr. Flanagan stated that his com- 
mittee was constructing an additional form of the test which 
they hoped to have ready by the spring of 1940. 

Reports were made by Mr. Beasley, chairman of the Com- 
mittee on Social Studies Tests; Mr. Morrison, chairman of 
the Committee on Biology Tests; Mr. Hilkert, chairman of 
the Committee on Chemistry Tests; and Dr. Traxler, who 
reported on the work of the Committee on Physics Tests in 
the absence of the chairman, Dr. Bartlett, of Phillips Exeter 
Academy. Each committee had held two meetings at which 
its objectives had been formulated and plans had been made 
for the construction of a new test in line with the objectives 
agreed upon by the majority of the schools who replied to a 
questionnaire sent out in the spring of 1939. It was agreed 
that summaries of the replies to the questionnaires should 
be sent to the Bureau’s member schools. 

At the chairman’s request, C. Thurston Chase, Jr., of the 
Eaglebrook School, reported on a suggestion concerning the 
need for a reading test which had just been brought before 
the Independent Schools Advisory Committee, which was 
holding its annual meeting at the same time. Mr. Chase 
pointed out that there was a dearth of diagnostic reading 
tests, particularly for the elementary school level, and he 
offered the proposal that the Tests and Measurements Com- 
mittee, or some other committee of the Educational Records 
Bureau, undertake to gather together and coordinate the 
present diagnostic reading tests and bring them into a single 
acceptable form which could be used for the diagnosis of 
reading difficulties. The ensuing discussion brought out the 
fact that the Cooperative Test Service is at present working 
on a new reading test for the secondary school and it was 
felt that probably the committee should await the develop- 





192. The Educational Record Supplement for January 1940 


ment of that test as far as the junior and senior high school 
grades are concerned, even though Dr. Flanagan pointed out 
that its diagnostic features might not exactly meet the need 
that Mr. Chase had in mind. The point was made that the 
preparation of a highly reliable diagnostic reading test for 
the elementary school would probably call for as much as four 
class periods of testing time and a question was raised con- 
cerning whether the elementary schools were ready to give 
that much time to the measurement of reading. Several per- 
sons representing elementary schools expressed the opinion 
that the schools would be willing to use a much longer and 
more reliable diagnostic reading test than any now available, 
and Dr. Dearborn suggested that perhaps this was a good 
time to launch the idea of a long test designed for the diag- 
nosis of reading difficulties. After considerable discussion, it 
was unanimously agreed that the matter be referred to a com- 
mittee of three for study and recommendation of appropriate 
action. 

A report was made by Dr. Traxler on the use by the Edu- 
cational Records Bureau of the Junior Scholastic Aptitude 
Test of the Secondary Education Board as a result of an 
agreement between the two organizations whereby the Second- 
ary Education Board furnishes the test and the Educational 
Records Bureau distributes it, scores it, and reports the results. 
It appeared that the use of the test in the spring and fall pro- 
grams of 1939 would reach a total of about two thousand 
copies. While this was very encouraging, it was felt that an 
effort should be made to increase the use in order to provide 
more adequate norms. It was stated that the Bureau was 
anxious to do everything possible to encourage the use of this 
excellent new test. Dr. Lester expressed satisfaction over 
the happy union of forces in the production and distribution 
of the Junior Scholastic Aptitude Test. 

Margaret Seder reported on a plan for the preparation of 
a bulletin to be entitled “Introduction to Testing and the Use 
of Test Results” to replace the “Handbook for Independent 
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Schools,” which is now out of print. Dr. Seder stated that 
she was preparing the bulletin in such form that separate chap- 
ters could be sent to the different schools for distribution to 
members of the faculty and that these chapters would later 
be included in a single bound volume. 

The chairman appointed Howard V. Funk to serve as the 
new chairman of the Subcommittee on Test Selection for a 
two-year term. Donald W. Goodrich was appointed as a 
member of the subcommittee to replace Dr. Traxler. 

The last item on the agenda was concerned with a recom- 
mendation of the Executive Committee that the Bureau 
committees adopt a plan of rotating membership on the 
basis of a three-year tenure. The committee took favorable 
action on the recommendation but it decided to use a four-year 
tenure, partly because the number of its members, sixteen, is 
divisible by four, and partly because it was felt that a three- 
year tenure was not long enough for membership on a com- 
mittee whose work is to some extent technical. It was decided 


that the order of rotation should be determined by lot. The 
committee passed a motion empowering the chairman to ap- 
point a subcommittee of two to meet with him and draw slips 
to indicate the order of retirement from the committee. The 
chairman was further empowered to appoint the new members 
to replace those retiring from the committee. The meeting 
then adjourned. 


COMMITTEE ON SCHOOL AND COLLEGE RELATIONS 
Eugene R. Smith, Chairman 


Members 


*Richard D. Allen, Providence Public Schools 
N. H. Batchelder, The Loomis School 
+Frank H. Bowles, Columbia University 
William L. W. Field, Milton Academy 
Josephine Gleason, Vassar College 


* Unable to attend. 
+ Represented by Bernard P. Ireland. 
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*E. D. Grizzell, University of Pennsylvania 

Richard M. Gummere, Harvard University 

*Frances L. Knapp, Wellesley College 

William S. Learned, Carnegie Foundation for the Advancement 
of Teaching 


J. L. McConaughy, Wesleyan University 

*A. B. Meredith, New York University 

H. Sherman Oberly, University of Pennsylvania 
Donald J. Shank, American Council on Education 
Eugene R. Smith, The Beaver Country Day School 
Stanley R. Yarnall, Germantown Friends School 


Guests 
Ralph Britton, The Loomis School 


Ben D. Wood, Cooperative Test Service and Educational Records 
Bureau 


The meeting was called to order by the chairman, Dr. Smith, 
who announced certain changes in the make-up of the commit- 
tee. C. R. Mann, president emeritus of the American Council 
on Education, had resigned from the committee and had been 
replaced by Donald J. Shank, assistant to the president. Carl 
Miller of the University of Pennsylvania had resigned and was 
replaced by H. Sherman Oberly of the same institution. John 
Tildsley had retired from educational work and had been re- 
placed by E. D. Grizzell. 

The chairman also announced that the Executive Committee 
of the Educational Records Bureau had asked all committees to 
reorganize the membership so that one-third of the members 
would retire each year, subject to the proviso that a member 
might be asked to succeed himself. The committee carried 
through this organization with the following results: 


To serve until the fall meeting of 1940: William L. W. Field, Wil- 
liam §. Learned, Donald J. Shank, A. B. Meredith, Richard D. Allen. 

To serve until the fall of 1941: Frank H. Bowles, Josephine Gleason, 
E. D. Grizzell, Frances L. Knapp, H. Sherman Oberly. 

To serve until the fall of 1942: N. H. Batchelder, Richard M. Gum- 
mere, J. L. McConaughy, Eugene R. Smith, Stanley R. Yarnall. 





* Unable to attend. 
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The chairman reported that the 1938 meeting had author- 
ized him to send a letter to the colleges when the time seemed 
ripe, to bring to their attention certain developments along the 
line of the previous reports sent out by the Bureau, but that 
developments had been such that it had seemed wise not to send 
the letter before further consideration by the committee. He 
reviewed briefly the character of the publications made by this 
committee in 1932 and 1935 and the responses that had been 
received. The recommendations asked the colleges (1) to em- 
phasize the importance of information about character and 
personality of candidates for admission, (2) to give serious 
consideration to data from comparable tests that had been 
taken by the candidate, and (3) to consider some students at 
least one year ahead of entrance in order to assist in their 
guidance. 

The general purpose has been to provide a broader basis 
for the judgment of candidates for admission to college than 
would be given by one set of entrance examinations as well as 
to encourage the schools towards more complete study of their 
pupils and better guidance procedures. 

During the last few years, and perhaps increasingly in the 
last year, there has been development in methods of recording 
information about boys and girls and at the present time there 
is projected a revision of the cumulative record cards for 
schools and colleges that are published by the American Coun- 
cil on Education. It seems likely that when this has been 
undertaken and the work of the recording committees of the 
Progressive Education Association has reached a point more 
nearly complete it will be advisable to communicate again with 
most schools and colleges reinforcing past recommendations 
and pointing out advances that have been made. 

The committee engaged in an extended discussion of these 
points and others. One point that was emphasized was the 
failure of many schools to carry on studies of their students 
that would make it possible for them to give to colleges authori- 
tative material of a kind that would supplement or replace the 
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results of examinations. It was freely stated that the colleges 
were increasingly liberal in their consideration of entrance 
information and that there was much flexibility in handling 
individual cases, even though a statement of such flexibility 
could not well be set down in definite terms in a publication. 
The need of more information about students as an aid in 
placement was brought out and there was considerable dis- 
cussion of the way in which guidance should be carried on as 
a continuous process through school and college. 

Reference was made to the fact that inclusion of discipli- 
nary action in a pupil’s record was sometimes seriously unfair 
to the student and the recommendations should be so phrased 
that it would not seem necessary to list occasions on which a 
student had failed to conform or had been in difficulty if the 
final report included a frank appraisal of the stage of develop- 
ment which was reached by the pupil at the time of transfer. 
The question of whether large schools could keep reasonably 
complete records about their pupils was raised and was an- 
swered by the fact that various school systems in cities of 
large size are keeping such analyses of their pupils very 
effectively. 

The conclusion of the committee was that as soon as the 
work of other committees related to this one reached a point 
where a report to the schools and colleges could be reasonably 
complete the chairman, with the assistance of any others whom 
he wished to call in, should prepare a form for such a report 
and should submit it to the committee for its approval. It 
was thought that a report should reach the schools as well as 
the colleges, emphasizing the increasing desire of colleges to 
have adequate information about students coming to them and 
the duty of the schools to prepare such material and to offer 
it to the colleges for their use. It was thought, however, that 
emphasis to the colleges on the importance of such material, 
not only for entrance but for their further use, should not be 
neglected as college procedures vary greatly in regard to this. 
The chairman reported more fully regarding the work of 
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the Subcommittees on Evaluation and Recording of the Pro- 
gressive Education Association which have also been adopted 
as subcommittees of this group. He told of the study made 
of reports being sent to the home and of the revised form that 
had been prepared, and also of the forms prepared for teach- 
ers of mathematics, science, English, and social studies, and 
the ones under way in various other fields. He also called 
attention to the effect of the new recording forms in making 
teachers aware of the purposes of their work. 

A discussion of this progress report resulted, in which the 
need of supervision of young teachers in using such material 
was pointed out and considerable emphasis was given to the 
value of the cumulative record that was built up by the year- 
after-year use of such material. 

Dr. Wood spoke of his experience in various parts of the 
country in relation to the use of recording forms and said 
that in many cases institutions were stimulated to improve 
their own material by seeing the reports of the various com- 
mittees, and that the idea presented in the various forms 
might be preserved even though the exact arrangement was 
somewhat changed. 

Mr. Shank asked the recommendation of the committee on 
the advisability of the American Council on Education’s re- 
maining the distributing agent for such forms as its cumulative 
record cards. The opinion of the committee was that the 
Council should continue to be the distributing agency since 
there was value in having it under the control of the Council 
and since there was a tendency in commercial handling of such 
material to freeze a form that would sell rather than to revise 
it at intervals frequent enough to keep it in line with the best 
thought on the subject. It was suggested that it might be 
necessary to revise such cards as often as every five years if 
developments continued at the present rate. 

The chairman then summarized the conclusions of the com- 
mittee which were accepted as official, after which the meeting 
adjourned. 
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Joint MEETING OF INDEPENDENT SCHOOLS ADvisoRY Com- 
MITTEE AND COMMITTEE ON RELATIONS BETWEEN 
ELEMENTARY AND SECONDARY SCHOOLS 


George A. Walton, Chairman 


INDEPENDENT SCHOOLS ADVISORY COMMITTEE 


Members 


*Demass Barnes, Shady Side Academy 
Ronald S. Beasley, Groton School 
Mary Helena Dey, The Mary C. Wheeler School 
*Claude M. Fuess, Phillips Academy 
*Allan V. Heely, The Lawrenceville School 
Robert N. Hilkert, The Hill School 
Paul B. Jacobson, University High School, Chicago 
Elizabeth F. Johnson, The Baldwin School 
Halleck Lefferts, Pomfret School 
George B. Lovell, Hopkins Grammar School 
J. Vaughan Merrick, St. George’s School 
*Harry A. Peters, University School, Cleveland 
David R. Porter, Mount Hermon School 
Edward Pulling, Millbrook School 
R. J. Shortlidge, The Pawling School 
E. Laurence Springer, The Pingry School 
Katharine Taylor, Shady Hill School 
*Dorothy Van Alstyne, Francis W. Parker School 
George A. Walton, George School 
Charles B. Weld, The Taft School 
Frank C. Wheeler, The Choate School 
Myron R. Williams, The Phillips Exeter Academy 
*James O. Wood, The Chicago Latin School 


*Stanley R. Yarnall, Germantown Friends School 


COMMITTEE ON RELATIONS BETWEEN ELEMENTARY 
AND SECONDARY SCHOOLS 


Members 


Frank D. Ashburn, Brooks School 
C. Thurston Chase, Jr., Eaglebrook School 
Hart Fessenden, The Fessenden School 


* Unable to attend. 
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Thomas K. Fisher, St. Paul’s School 
Halleck Lefferts, Pomfret School | 
Francis Parkman, St. Mark’s School 
Clark W. Slade, The Slade School 
E. H. Smith, Shady Hill School 

Charles B. Weld, The Taft School 


Guests 









Bobby Traxler, Educational Records Bureau 
Eleanor Perry Wood, Educational Records Bureau \ 
Ben D. Wood, Educational Records Bureau and Cooperative . 
Test Service 





























The meeting was called to order by the chairman, who 
announced, as the first item on the agenda, the election in 
the recent ballot of the following persons to membership 
on the Independent Schools Advisory Committee: Hart Fes- 
senden, The Fessenden School; Robert N. Hilkert, The Hill ) 
School; and Ralph Britton, The Loomis School. : 

A report by Dr. Wood, director of the Educational Rec- 
ords Bureau, followed. Organization and membership graph : 
charts were handed to the committee members, and the direc- 
tor stated that the present actual Bureau membership is 358 
schools, of which 88 per cent are independent schools, 7 per 
cent public schoois, and 5 per cent institutions of higher educa- 
tion. Dr. Wood reported that the Committee on the Con- 
struction of Mathematics Tests appointed nearly three years 
ago by the Tests and Measurements Committee had accom- 
plished a great deal and the four new test evaluation and 
construction committees appointed last year had made signifi- 
cant progress with plans for work in their respective fields. 
He stated that the Board of Trustees appropriated $1,500 
last year for the work of the committees on test evaluation 
and construction, and that it was hoped that a similar appro- 
priation could be made this year to enable them to continue 
their work. Copies of three chapters of the new primer on 
educational testing and guidance, now in preparation by Dr. 
Seder of the Bureau staff with the editorial cooperation of 


200 The Educational Record Supplement for January 1940 


several Bureau committees, were handed to the members. 
They were typed and printed on the Vari-Typer and multi- 
graph duplicator, new machines acquired by the Bureau last 
year, which permit the production of up to ten thousand copies 
from a single set of plates. The primer is to be issued to mem- 
ber schools a chapter at a time in order to encourage teachers 
to read it and return comments to the Bureau. From two to 
six copies will be sent free to member schools and any number 
requested will be made available at the lowest possible cost. 
Dr. Wood reported that the Board of Trustees last spring 
established an Executive Committee, consisting of the direc- 
tor, associate director, and assistant director of the Bureau, 
and Dean Hawkes representing colleges, Mr. Heely repre- 
senting independent schools, and Dr. Bair representing public 
schools, to do the executive work of the Bureau. 

Mr. Fessenden, acting chairman of the Committee on Rela- 
tions between Elementary and Secondary Schools in the absence 
of Mr. Weld, reported that although neither favorable nor 
adverse comment had been forthcoming, many elementary 
schools seem to have accepted and appear glad to use the rec- 
ord card prepared by the Subcommittee of the Committee on 
Relations between Elementary and Secondary Schools. He 
suggested that as a follow-up, a questionnaire requesting sug- 
gestions for improving the card should be sent to schools. 
Attention was directed to a reprint from The Elementary 
School Journal (Vol. XL, No. 1, September, 1939) of “A 
Cumulative-Record Form for the Elementary School,” by Dr. 
Traxler of the Bureau, describing a technique for its use which 
is recommended to member schools. Mr. Fessenden reported, 
further, that a member of the committee has suggested that it 
would be well to devise a plan for scoring Secondary Educa- 
tion Board Examinations by a central committee to increase 
the value of their results for use on cumulative records. 

A need for the improvement of reading tests now in use, 
particularly with reference to their diagnostic quality, was 
pointed out, and the comparison, revision, and coordination 
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of a new set of diagnostic reading tests for the use of member 
schools was suggested. A motion was passed to the effect that 
this suggestion be carried to the Committee on Tests and 
Measurements meeting concurrently with the Independent 
Schools Advisory Committee, and Mr. Chase was appointed 
to act as emissary. Mr. Chase brought back the report that 
the suggestion was favorably received by the Tests and Meas- 
urements Committee, who agreed that a committee of three 
should be appointed to study the matter and recommend 
appropriate action within the year. 

The fourth agenda item was concerned with the Executive 
Committee’s recommendation that the Committee on Rela- 
tions between Elementary and Secondary Schools be made a 
permanent subcommittee of the Independent Schools Advisory 
Committee, preferably retaining the present membership for 
the sake of continuity of work, and establishing a plan of rota- 
tion to provide for future membership changes. The acting 
chairman of the Committee on Relations between Elementary 
and Secondary Schools pointed out that this committee, ap- 
pointed several years ago by the Independent Schools Advis- 
ory Committee, had functioned without technical legality, no 
consideration having been given to its membership or manner 
of selection of new members since the original appointment. It 
was voted that a subcommittee of three be appointed by the 
chairman of the Independent Schools Advisory Committee to 
assume the responsibility of working out details concerned 
with the reorganization of the two committees. 

Next, F. C. Wheeler, chairman of the Subcommittee on 
Reporting Techniques, submitted a report the summary of 
which is appended to these minutes. The Independent Schools 
Advisory Committee voted that a permanent subcommittee to 
be known as the Technical Committee, consisting of six mem- 
bers, be appointed by the chairman for a definite term of office 
with rotation of membership, to undertake the work outlined 
by Mr. Wheeler in his report, and also to undertake a study 
of several questions raised by Dr. Jacobson in elaboration of 
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Mr. Wheeler’s outline. Dr. Jacobson’s suggestions—of which 
the following is a brief summary—seemed of such vital con- 
cern to the committee that the members voted to hold an 
adjourned, open meeting, to be announced at the Conference, 
at five o’clock for further consideration of the ideas set forth: 

A technical committee should consider ways of making test 
results more meaningful and helpful to member schools: care- 
ful and exact descriptions of test objectives should be made 
available; more adequate descriptions of the population on 
which the norms for each test are based should be made—the 
population tested being specifically described as to academic 
background and as to ability levels involved—and compara- 
tive scores from year to year should be furnished to member 
schools so that they can draw their own inferences as to the 
type of progress and of instruction which is going on and also 
draw valid conclusions for guidance purposes. 

The sixth item considered was the Executive Committee’s 
recommendation that all standing committees of the Bureau 
be organized similarly with respect to method of obtaining 
new members and their terms of office by applying the prin- 
ciple of rotation on the basis of three-year tenure, allowing 
members to succeed themselves, and establishing control of 
membership by appointing some members rather than having 
them elected by members at large. It was suggested that the 
power of appointment should be left with the Independent 
Schools Advisory Committee, and the recommendation of 
three-year tenure of office be endorsed. There is a possibility, 
it was at once noted, that should all committee members be 
appointed, instead of being elected as at present, the pro- 
cedure will lose its present democratic aspect. Then it was 
pointed out that it would be to the advantage of both the 
Bureau and the committee to have at least a certain propor- 
tion appointed as there is a tendency for the present balloting 
to result in inadequate representation of certain of the inde- 
pendent schools, such as girls’ schools and military schools. 
After considerable discussion, the committee voted to submit 
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to the Executive Committee a recommendation that a certain 
portion of the membership, approximately one-third and not 
more than one-half, be appointed by the chairman of the 
Independent Schools Advisory Committee, and the others be 
elected by ballot as at present, so that at all times a definite 
working majority of the committee should hold office by vote. 

In connection with the following three plans for increasing 
the Bureau’s income, submitted for consideration by the Exec- 
utive Committee, it was emphasized that routine services are 
adequately covered by present charges, but finances have not 
been adequate to cover a systematic basic research program 
to make the service as complete as it might be. Plan A pro- 
posed to increase the membership fee from $15 to $25; plan 
B suggested the addition of $10 to the program fee of schools 
not contributing to centrally obtained normative data; and 
plan C involved the substitution of a per-pupil basis of testing 
costs for the present per-test basis. Considerable interest was 
expressed in plans A and B. The chief objection expressed to 
plan A was that it would place a rather heavy burden upon 
schools having just sufficient funds to enable them to secure 
membership in the Bureau and also upon those who like to 
be members to support a good cause or obtain publications 
and manuals. There was some criticism of plan B on the 
ground that it would make costs to schools doing local scoring 
higher than they would otherwise be, whereas the usual reason 
for local scoring is that outside scoring is beyond the means 
of certain schools. It was felt that an increase on the basis of 
either A or B would work a hardship on a few schools with 
slim budgets. As for plan C, it was emphasized that this is in 
no way intended as a substitute for the service the Bureau is 
now and has been giving. It was suggested that a graduated 
scale of costs for the program would be difficult to devise 
without imposing hardships on partially participating schools. 
The chairman summed up the general sense of the discussion 
as showing great interest in plans A and B and scarcely any 
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interest in plan C and ruled that the discussion be closed, 
leaving the matter in abeyance for the time being. 

The final item to be considered was the question of testing 
plans and dates for independent school programs. The chair- 
man briefly reported that although a majority of schools 
favored the early testing date, one year’s experience with it 
apparently had the effect of reducing the number of tests sold 
and used, although the situation was somewhat obscured by 
the fact that some schools reacted unfavorably to the short 
Cooperative Tests introduced the year before. The results of 
a special questionnaire from the Bureau, it was reported, had 
indicated that about 71 per cent of twenty-eight elementary 
schools, 49 per cent of eighty-four secondary schools, and 70 
per cent of fifty-three schools serving both elementary and 
secondary fields, prefer the first two weeks of March for their 
1940 program, making a combined total of about 55 per cent 
of all schools. It was nevertheless felt that the dissent of as 
many as half of the secondary schools was extremely signifi- 
cant. The chairman pointed out that inasmuch as the early 
March testing date had been recommended by a special com- 
mittee for a two-year trial, the Advisory Committee is commit- 
ted to early March again in 1940. A motion was made calling 
for the appointment of a small committee, or designation of 
an existing committee, by the chairman, to make another study 
in connection with the spring program as a preliminary to sub- 
mitting recommendations to the Advisory Committee next fall. 
This motion was carried and the meeting was then adjourned. 

The adjourned session of the committee the same afternoon 
at five o’clock discussed Dr. Jacobson’s suggestions in detail, 
emphasizing particularly the difficulties involved in using the 
Latin norms now published. As the spring achievement tests 
are more widely used than the American Council Psychological 
Examination in the fall, the Bureau cannot get information as 
to the ability levels of all pupils included in the spring norms. 
Further consideration of these matters was referred to the 
Technical Committee. 
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A REPORT OF THE SUBCOMMITTEE ON REPORTING 
TECHNIQUES PRESENTED TO THE INDEPEND- 
ENT SCHOOLS ADVISORY COMMITTEE OF 
THE EDUCATIONAL RECORDS BUREAU 


1. Origin and Personnel 





The Committee on Reporting Techniques was appointed by the Inde- 
pendent Schools Advisory Committee at the annual meeting in October 
1936, to study the characteristics of the Scaled Scores then originating, 
the method of reporting the results of tests then used by the Bureau, the 
method of reporting on cumulative records, the method of interpreting 
the results, and such related questions. The original committee con- 
sisted of Mr. Fisher of St. Paul’s, Mr. Nomer of Shady Side, Mr. 
Hilkert of Hill, and Mr. F. C. Wheeler of Choate. Mr. Ralph Britton 
of the Loomis School and Mr. J. A. Wheeler of Eaglebrook were later 
added to this committee and Mr. Nomer resigned. Meetings are held ; 
annually—no meeting was held during the past year, because various | 
dates proposed for one reason or another had to be given up. 


2. Present Function 




















The committee has continued to exist because it is felt that it is and 
should be concerned with and available for advice on technical problems 
relating to service from the Educational Records Bureau to the inde- 
pendent schools, excluding the selection, evaluation, and construction of 
tests, and those transfer and admission problems that properly belong 
to the Committee on Relations between Elementary and Secondary 
Schools and to the School and College Relations Committee. 

There are still many special functions and problems which might well 
concern this committee. “The most important, and at present the most 
interesting, is the publication of the new primer on educational testing 
and guidance now in preparation. It is felt that the members of this 
committee may serve as editorial consultants on such a publication. The 
revision of the old handbook for independent schools was one of the first 
considerations of this committee. 

Study of the Strong Vocational Interest Blank, its revision and its 
usefulness, is a tempting field, as is the opportunity opened by the new | 
item analysis unit of the International scoring machine. 

Aside from these specific problems, there are always current problems 
having to do with reporting forms and the reporting, recording, and 
use of test results. 
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3. Proposals 


At present, your chairman believes that this committee should be made 
permanent on the basis of definite tenure of term, and with rotation of 
membership. I suggest that the committee have at least six members, 
and that a system of rotation be determined and set in motion. The 
Independent Schools Advisory Committee should appoint to this sub- 
committee the new members, and designate the chairman of the subcom- 
mittee. The subcommittee should be made a permanent subcommittee 
of the Independent Schools Advisory Committee, and arrangement 
should be made for a close connection with the Subcommittee on Test 
Selection of the Committee on Tests and Measurements. 

The cumbersome name of this committee could well be shortened. It 
might well be called the Technical Subcommittee of the Independent 
Schools Advisory Committee. 


FRANK C. WHEELER, Chairman 
October 26, 1939 


PuBLic SCHOOLS ADVISORY COMMITTEE 
Frederick H. Bair, Chairman 


Members 

Richard D. Allen, Providence Public Schools 

Frederick H. Bair, Bronxville Public Schools 
*Paul D. Collier, Connecticut Department of Education 

John C. Flanagan, Cooperative Test Service 

Roy S. Haggard, East Hartford High School 

Galen Jones, Plainfield High School 
*William S. Learned, Carnegie Foundation for the Advancement 

of Teaching 

E. F. Lindquist, State University of Iowa 

A. B. Meredith, New York University 

Lester W. Nelson, Scarsdale High School 

Sydney V. Rowland, Radnor Township Public Schools 
*J. L. Stenquist, Director of Research, Baltimore 
*Howard Dare White, New Jersey Department of Education 
E. G. Williamson, University of Minnesota 


Guests 


Frederick W. Cook, Plainfield Public Schools 
Irene Fike, Scarsdale High School 


* Unable to attend. 
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Vernon C. Smith, Scarsdale Public Schools 

I. R. Kraybill, Cheltenham Township High School 
Anna Rose Hawkes, Educational Records Bureau 
*Ernest S. Brown, Groton, Connecticut 


The final report on the Public School Demonstration Project 
in Educational Guidance which was carried on for five years in 
seven school systems under a grant from the Carnegie Foun- 
dation was made by Anna Rose Hawkes. The cooperating 
centers were Billings, Montana; Greeley, Colorado (Second- 
ary School of the State College of Education) ; Groton, Con- 
necticut; Plainfield, New Jersey; Rochester, Minnesota; San 
Antonio, Texas; and Scarsdale, New York. A 350-page 
printed report, edited by Dr. Traxler of the Bureau, was dis- 
tributed to the committee members. The printed report was 
a cooperative project and included contributions by Dr. Wood 
and Mrs. Hawkes, of the Bureau; Galen Jones and Adria 
Galbraith, of the Plainfield High School; Lester W. Nelson, 
of the Scarsdale High School; William L. Wrinkle, of the 
Colorado State College of Education; Thomas B. Portwood, 
of the San Antonio Public Schools; and Charles D. Dean, of 
the Eastern Montana State Normal School. It also contained 
fifteen case studies selected from some two hundred such 
studies which had been prepared by classroom teachers. The 
report as a whole was designed to show how modern measure- 
ment, recording, and guidance practices can be applied at the 
secondary school level. Various suggestions were made for 
bringing the report to the attention of other public schools and 
instructors of guidance classes in departments of education. 

Comments on the values of the project to the participating 
schools were made by Dr. Jones, Mr. Nelson, and Mr. Hag- 
gard. Dr. Jones stated that there were fewer failures, that 
more pupils seek counsel, and that more parents seek informa- 
tion concerning the progress of their children. Mr. Nelson 
stated that the project had brought about improvement in the 





* Represented by Betty Wheeler. 
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cumulative record, had provided helpful data for use in keep- 
ing the parents informed about the achievement of the pupils, 
and had helped to make guidance a major function of the school. 
Mr. Haggard commented on various aspects of the project 
that he felt other schools could profitably adopt. 

There was considerable discussion of ways in which the 
Bureau might carry forward and increase its services to public 
schools. It was felt that the test scoring and reporting services 
to public schools should be continued on the same basis as 
at present and that an effort should be made to extend the 
Bureau’s machine-scoring services to non-members. It was re- 
ported that the loan service of record and report forms which 
the Bureau began during the project had already been helpful 
to nearly two hundred schools and the Bureau was requested 
to continue this service. 

It was suggested that the Bureau attempt to extend its 
services to a few public schools by showing them the value of 
cumulative test records of individual pupil progress. 

The committee took favorable action on the recommenda- 
tion of the Executive Committee to the effect that the Bureau 
committees adopt a plan of rotating membership. A motion 
was passed that the membership be increased to fifteen and 
that the matter of working out the details be turned over to 
the chairman, who was requested to advise the committee of 
his action. It was suggested that in addition to the regular 
committee there be an advisory group of nine to come into 
the meeting when called. 

It was the consensus of opinion that more meetings of the 
committee should be held each year. The chairman was re- 
quested to try to enlist the active cooperation of all members 
in the committee’s work of encouraging measurement and 
guidance programs in public schools. 








